Apr 15 10:01:05 devstack cinder-volume[72902]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 10:01:05 devstack cinder-volume[72902]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:01:05 devstack cinder-volume[72902]: we strongly recommend against using it for new projects. Apr 15 10:01:05 devstack cinder-volume[72902]: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:01:05 devstack cinder-volume[72902]: framework. For more detail see Apr 15 10:01:05 devstack cinder-volume[72902]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:01:05 devstack cinder-volume[72902]: import eventlet # noqa Apr 15 10:01:07 devstack cinder-volume[72902]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72902) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:01:07 devstack cinder-volume[72902]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72902) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:01:07 devstack cinder-volume[72902]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72902) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:01:08 devstack cinder-volume[72902]: INFO dbcounter [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Registered counter for database cinder Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_db.sqlalchemy.engines [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG dbcounter [-] [72902] Writer thread running {{(pid=72902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:01:08 devstack cinder-volume[72902]: INFO cinder.rpc [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 10:01:08 devstack cinder-volume[72902]: INFO cinder.rpc [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_db.sqlalchemy.engines [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:08 devstack cinder-volume[72902]: INFO cinder.volume.manager [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Determined volume DB was empty at startup. Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG cinder.volume.manager [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72902) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 10:01:08 devstack cinder-volume[72902]: INFO cinder.volume.manager [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 10:01:08 devstack cinder-volume[72902]: WARNING stevedore.named [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:01:08 devstack cinder-volume[72902]: WARNING castellan.key_manager [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:01:08 devstack cinder-volume[72902]: WARNING cinder.keymgr.conf_key_mgr [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG cinder.volume.drivers.lvm [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72902) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_concurrency.processutils [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_concurrency.processutils [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.283s {{(pid=72902) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_db.sqlalchemy.engines [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:08 devstack cinder-volume[72902]: INFO cinder.rpc [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 15 10:01:08 devstack cinder-volume[72902]: INFO cinder.rpc [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 15 10:01:08 devstack cinder-volume[72902]: WARNING stevedore.named [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:01:08 devstack cinder-volume[72902]: WARNING castellan.key_manager [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:01:08 devstack cinder-volume[72902]: INFO cinder.volume.manager [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_db.sqlalchemy.engines [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72902) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:08 devstack cinder-volume[72902]: INFO oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Starting 1 workers Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Started child 73008 {{(pid=72902) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Full set of CONF: {{(pid=72902) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] ******************************************************************************** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Configuration options gathered from: {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 10:01:08 devstack cinder-volume[73008]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] ================================================================================ {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] allow_availability_zone_fallback = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] allow_compression_on_image_upload = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] allowed_direct_url_schemes = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] api_rate_limit = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] auth_strategy = keystone {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] az_cache_duration = 3600 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_availability_zone = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_host = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_stats_polling_interval = 60 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backup_api_class = cinder.backup.api.API {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backup_name_template = backup-%s {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backup_use_same_host = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backup_use_temp_snapshot = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] chap_password = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] chap_username = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cinder_internal_tenant_project_id = c021911289f046518583ae8febd3bbcf {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cinder_internal_tenant_user_id = 823c690775b3445889dae808e8aff0a6 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cloned_volume_same_az = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cluster = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] compression_format = gzip {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] compute_api_class = cinder.compute.nova.API {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] config_dir = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] config_source = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] control_exchange = openstack {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] debug = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] default_availability_zone = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] default_group_type = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] default_volume_type = lvmdriver-1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] disk_geometry = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] driver_client_cert = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] driver_client_cert_key = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] driver_data_namespace = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] driver_ssl_cert_path = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] driver_ssl_cert_verify = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] driver_use_ssl = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] enable_force_upload = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] enable_new_services = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] enable_unsupported_driver = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] enforce_multipath_for_image_xfer = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] filter_function = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_api_insecure = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_api_servers = ['http://192.168.122.189/image'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_api_ssl_compression = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_ca_certificates_file = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_catalog_info = image:glance:publicURL {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[73008]: INFO cinder.volume.manager [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_certfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_keyfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_num_retries = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance_request_timeout = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] goodness_function = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] graceful_shutdown_timeout = 5 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] group_api_class = cinder.group.api.API {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] host = devstack {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_compress_on_upload = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_conversion_address_space_limit = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_conversion_cpu_limit = 60 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_conversion_disable = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_upload_use_cinder_backend = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_upload_use_internal_tenant = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_volume_cache_enabled = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_volume_cache_max_count = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] image_volume_cache_max_size_gb = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] init_host_max_objects_retrieval = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] instance_format = [instance: %(uuid)s] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] iscsi_target_flags = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] iscsi_write_cache = on {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] iser_helper = tgtadm {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] iser_ip_address = 192.168.122.189 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] iser_port = 3260 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] log_color = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] log_config_append = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] log_dir = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] log_file = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] log_options = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] log_rotate_interval = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] log_rotate_interval_type = days {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] log_rotation_type = none {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] max_age = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] max_logfile_count = 30 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] max_logfile_size_mb = 200 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] max_over_subscription_ratio = 20.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] message_reap_interval = 86400 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] message_ttl = 2592000 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] migration_create_volume_timeout_secs = 300 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] monkey_patch = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] monkey_patch_modules = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] my_ip = 192.168.122.189 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] no_snapshot_gb_quota = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] num_iser_scan_tries = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] num_shell_tries = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] num_volume_device_scan_tries = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] nvmeof_conn_info_version = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] nvmet_ns_id = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] nvmet_port_id = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] osapi_max_limit = 1000 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] osapi_volume_ext_list = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] osapi_volume_listen_port = 8776 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] osapi_volume_use_ssl = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] osapi_volume_workers = 2 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] per_volume_size_limit = -1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] periodic_fuzzy_delay = 60 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] periodic_interval = 60 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] public_endpoint = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] publish_errors = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] quota_backup_gigabytes = 1000 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] quota_backups = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] quota_gigabytes = 1000 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] quota_groups = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] quota_snapshots = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] quota_volumes = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] rate_limit_burst = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] rate_limit_except_level = CRITICAL {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] rate_limit_interval = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] reinit_driver_count = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] replication_device = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] report_discard_supported = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] report_interval = 120 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] reservation_clean_interval = 86400 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] reservation_expire = 86400 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] reserved_image_namespaces = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] reserved_percentage = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] rpc_response_timeout = 120 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] run_external_periodic_tasks = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] scst_target_driver = iscsi {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] scst_target_iqn_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_down_time = 720 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] shell_completion = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] snapshot_name_template = snapshot-%s {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] snapshot_same_host = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] split_loggers = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] state_path = /opt/stack/data/cinder {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] storage_availability_zone = nova {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] storage_protocol = iSCSI {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] syslog_log_facility = LOG_USER {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] target_helper = lioadm {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] target_ip_address = 192.168.122.189 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] target_port = 3260 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] target_protocol = iscsi {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] target_secondary_ip_addresses = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] trace_flags = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] transport_url = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] until_refresh = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] use_chap_auth = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] use_default_quota_class = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] use_journal = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] use_json = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] use_multipath_for_image_xfer = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] use_stderr = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] use_syslog = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] verify_glance_signatures = enabled {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_api_class = cinder.volume.api.API {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_backend_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_clear = zero {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_clear_ionice = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_clear_size = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_copy_bps_limit = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_dd_blocksize = 1M {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_name_template = volume-%s {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_service_inithost_offload = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volume_usage_audit_period = month {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] zoning_mode = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_concurrency.disable_process_locking = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.admin_password = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.admin_token = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.admin_user = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.auth_port = 35357 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.auth_protocol = https {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.auth_section = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.auth_type = password {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.auth_uri = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.auth_version = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.cache = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.certfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.identity_uri = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.include_service_catalog = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.insecure = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.interface = public {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.keyfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_password = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcache_username = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.region_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.service_type = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.backend = dogpile.cache.null {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.backend_argument = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.backend_expiration_time = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.config_prefix = cache.oslo {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.debug_cache_backend = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.enable_retry_client = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.enable_socket_keepalive = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.enabled = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.enforce_fips_mode = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.expiration_time = 600 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.hashclient_retry_attempts = 2 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.memcache_dead_retry = 300 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.memcache_pool_maxsize = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.memcache_sasl_enabled = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.password = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.proxies = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.redis_db = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.redis_server = localhost:6379 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.retry_attempts = 2 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.retry_delay = 0.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.socket_keepalive_count = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.socket_keepalive_idle = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.socket_keepalive_interval = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.socket_timeout = 1.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.tls_allowed_ciphers = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.tls_cafile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.tls_certfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.tls_enabled = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.tls_keyfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cache.username = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] coordination.backend_url = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.asyncio_connection = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.asyncio_slave_connection = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.backend = sqlalchemy {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.connection = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.connection_debug = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.connection_parameters = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.connection_recycle_time = 3600 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.connection_trace = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.db_inc_retry_interval = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.db_max_retries = 20 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.db_max_retry_interval = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.db_retry_interval = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.max_overflow = 50 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.max_pool_size = 5 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.max_retries = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.mysql_wsrep_sync_wait = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.pool_timeout = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.retry_interval = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.slave_connection = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.sqlite_synchronous = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.synchronous_reader = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] database.use_db_reconnect = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.connection_string = messaging:// {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.enabled = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.es_doc_type = notification {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.es_scroll_size = 10000 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.es_scroll_time = 2m {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.filter_error_trace = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.hmac_keys = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.sentinel_service_name = mymaster {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.socket_timeout = 0.1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.trace_requests = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler.trace_sqlalchemy = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler_jaeger.process_tags = {} {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler_jaeger.service_name_prefix = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] profiler_otlp.service_name_prefix = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.enforce_new_defaults = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: WARNING oslo_config.cfg [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.enforce_scope = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.policy_default_rule = default {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.policy_file = policy.yaml {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack sudo[73018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack sudo[73018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] privsep_osbrick.group = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] privsep_osbrick.helper_command = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] privsep_osbrick.user = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cinder_sys_admin.group = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cinder_sys_admin.helper_command = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] cinder_sys_admin.user = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.auth_section = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.auth_type = password {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.cafile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.certfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.collect_timing = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.insecure = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.keyfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.send_service_user_token = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.split_loggers = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] service_user.timeout = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.auth_section = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.auth_type = password {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.certfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.collect_timing = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.insecure = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.keyfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.region_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.split_loggers = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] glance.timeout = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.backend_availability_zone = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.chap_password = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.chap_username = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.disk_geometry = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.driver_client_cert = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.driver_client_cert_key = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.driver_data_namespace = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.driver_use_ssl = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.extra_capabilities = {} {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.filter_function = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.goodness_function = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.iscsi_target_flags = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.iscsi_write_cache = on {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.iser_helper = tgtadm {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.iser_port = 3260 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.lvm_share_target = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.lvm_type = auto {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.num_shell_tries = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.replication_device = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.report_discard_supported = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.reserved_percentage = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.target_helper = tgtadm {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.target_port = 3260 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.target_protocol = iscsi {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.trace_flags = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.unique_fqdn_network = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.use_chap_auth = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volume_backend_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volume_clear = zero {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volume_clear_ionice = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volume_clear_size = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_reports.file_event_handler = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_reports.log_dir = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.backend_host = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.chap_password = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.chap_username = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.disk_geometry = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.driver_client_cert = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.extra_capabilities = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.filter_function = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.goodness_function = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.iser_helper = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.iser_ip_address = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.iser_port = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.lvm_share_target = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.lvm_type = auto {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.num_shell_tries = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.replication_device = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.report_discard_supported = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.reserved_percentage = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.scst_target_driver = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.storage_protocol = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.target_helper = lioadm {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.target_ip_address = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.target_port = 3260 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.trace_flags = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.use_chap_auth = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volume_clear = zero {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volume_clear_size = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] lvmdriver-1.volumes_dir = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:08 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.ssl = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_notifications.driver = [] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_notifications.retry = -1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] key_manager.fixed_key = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.barbican_api_version = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.barbican_endpoint = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.barbican_endpoint_type = public {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.barbican_region_name = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.cafile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.certfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.collect_timing = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.insecure = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.keyfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.number_of_retries = 60 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.retry_delay = 1 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.send_service_user_token = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.split_loggers = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.timeout = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.verify_ssl = True {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican.verify_ssl_path = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican_service_user.auth_section = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican_service_user.auth_type = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican_service_user.cafile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican_service_user.certfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican_service_user.collect_timing = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican_service_user.insecure = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican_service_user.keyfile = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican_service_user.split_loggers = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] barbican_service_user.timeout = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.approle_role_id = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.approle_secret_id = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.kv_mountpoint = secret {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.kv_path = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.kv_version = 2 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.namespace = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.root_token_id = **** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.ssl_ca_crt_file = None {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.timeout = 60.0 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.use_ssl = False {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:01:09 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] ******************************************************************************** {{(pid=72902) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 10:01:09 devstack sudo[73018]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:09 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:09 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:09 devstack sudo[73023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:09 devstack sudo[73023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:10 devstack sudo[73023]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.555s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:01:10 devstack cinder-volume[73008]: INFO cinder.brick.local_dev.lvm [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 15 10:01:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:10 devstack sudo[73269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:10 devstack sudo[73269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:10 devstack sudo[73269]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.533s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:10 devstack cinder-volume[73008]: DEBUG cinder.brick.local_dev.lvm [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73008) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 15 10:01:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:10 devstack sudo[73485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:10 devstack sudo[73485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:11 devstack sudo[73485]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.136s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:11 devstack sudo[73670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:11 devstack sudo[73670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:12 devstack sudo[73670]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:12 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.549s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:12 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:12 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:12 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:12 devstack sudo[73707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 15 10:01:12 devstack sudo[73707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:12 devstack sudo[73707]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:12 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.492s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:12 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:12 devstack sudo[73714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:12 devstack sudo[73714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:13 devstack sudo[73714]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:13 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:13 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:13 devstack sudo[73719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:13 devstack sudo[73719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:13 devstack sudo[73719]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:13 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.525s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:13 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:13 devstack sudo[73723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:13 devstack sudo[73723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:14 devstack sudo[73723]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:14 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.550s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:14 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:14 devstack sudo[73727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:14 devstack sudo[73727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:14 devstack sudo[73727]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:14 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.514s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:14 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:14 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:14 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:14 devstack sudo[73739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:14 devstack sudo[73739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:15 devstack sudo[73739]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:15 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:15 devstack cinder-volume[73008]: INFO cinder.volume.drivers.lvm [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 15 10:01:15 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:15 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:15 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:15 devstack sudo[73854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:15 devstack sudo[73854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:16 devstack sudo[73854]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:16 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:16 devstack cinder-volume[73008]: DEBUG cinder.volume.drivers.lvm [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Updating volume stats {{(pid=73008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:01:16 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:16 devstack sudo[73885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:16 devstack sudo[73885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:16 devstack sudo[73885]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:16 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:16 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:16 devstack sudo[73995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:16 devstack sudo[73995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:17 devstack sudo[73995]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:17 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.496s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:17 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:17 devstack sudo[74002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:17 devstack sudo[74002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:17 devstack sudo[74002]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:17 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.478s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:17 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:17 devstack sudo[74005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:17 devstack sudo[74005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:18 devstack sudo[74005]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:18 devstack cinder-volume[73008]: INFO cinder.volume.driver [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG cinder.volume.driver [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73008) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG oslo_db.sqlalchemy.engines [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73008) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG dbcounter [-] [73008] Writer thread running {{(pid=73008) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG cinder.db.sqlalchemy.api [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Building query based on filter {{(pid=73008) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG cinder.image.image_utils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73008) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 10:01:18 devstack cinder-volume[73008]: INFO cinder.keymgr.migration [None req-1f3259b9-0961-4da7-8f54-bc7a65204d8f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG cinder.volume.drivers.lvm [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Updating volume stats {{(pid=73008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:18 devstack sudo[74009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:18 devstack sudo[74009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:18 devstack sudo[74009]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:18 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:18 devstack sudo[74013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:18 devstack sudo[74013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:18 devstack cinder-volume[72902]: DEBUG dbcounter [-] [72902] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72902) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:01:19 devstack sudo[74013]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:19 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.508s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:19 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:19 devstack sudo[74021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:19 devstack sudo[74021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:19 devstack sudo[74021]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:19 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.549s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:19 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:19 devstack sudo[74026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:19 devstack sudo[74026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:20 devstack sudo[74026]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:20 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.540s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:20 devstack cinder-volume[73008]: DEBUG cinder.manager [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Notifying Schedulers of capabilities ... {{(pid=73008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:01:20 devstack cinder-volume[73008]: INFO cinder.volume.manager [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Driver initialization completed successfully. Apr 15 10:01:20 devstack cinder-volume[73008]: INFO cinder.manager [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Initiating service 2 cleanup Apr 15 10:01:20 devstack cinder-volume[73008]: INFO cinder.manager [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Service 2 cleanup completed. Apr 15 10:01:20 devstack cinder-volume[73008]: DEBUG cinder.service [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Creating RPC server for service cinder-volume {{(pid=73008) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 10:01:20 devstack cinder-volume[73008]: DEBUG cinder.service [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73008) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 10:01:20 devstack cinder-volume[73008]: INFO cinder.volume.manager [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 15 10:01:20 devstack cinder-volume[73008]: DEBUG cinder.volume.drivers.lvm [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Updating volume stats {{(pid=73008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:01:20 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:20 devstack sudo[74030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:01:20 devstack sudo[74030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:20 devstack sudo[74030]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:20 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:20 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:20 devstack sudo[74087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:20 devstack sudo[74087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:21 devstack sudo[74087]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:21 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:21 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:21 devstack sudo[74352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:01:21 devstack sudo[74352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:21 devstack sudo[74352]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:21 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:21 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:01:21 devstack sudo[74356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:01:21 devstack sudo[74356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:01:22 devstack sudo[74356]: pam_unix(sudo:session): session closed for user root Apr 15 10:01:22 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:01:22 devstack cinder-volume[73008]: INFO cinder.volume.manager [None req-300329cf-235f-41ad-8e97-ca6810bf0724 None None] Driver post RPC initialization completed successfully. Apr 15 10:01:32 devstack cinder-volume[73008]: DEBUG dbcounter [-] [73008] Writing DB stats cinder:SELECT=3 {{(pid=73008) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:01:32 devstack cinder-volume[73008]: DEBUG dbcounter [-] [73008] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73008) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:02:10 devstack cinder-volume[73008]: DEBUG oslo_service.periodic_task [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73008) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:02:10 devstack cinder-volume[73008]: DEBUG cinder.volume.drivers.lvm [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Updating volume stats {{(pid=73008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:02:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:02:10 devstack sudo[76352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:02:10 devstack sudo[76352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:02:10 devstack sudo[76352]: pam_unix(sudo:session): session closed for user root Apr 15 10:02:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:02:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:02:10 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:02:10 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:02:11 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Apr 15 10:02:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:02:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:02:11 devstack sudo[76366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:02:11 devstack sudo[76366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:02:11 devstack sudo[76366]: pam_unix(sudo:session): session closed for user root Apr 15 10:02:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.441s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:02:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:02:11 devstack sudo[76370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:02:11 devstack sudo[76370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:02:12 devstack sudo[76370]: pam_unix(sudo:session): session closed for user root Apr 15 10:02:12 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:02:12 devstack cinder-volume[73008]: DEBUG cinder.manager [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Notifying Schedulers of capabilities ... {{(pid=73008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:03:10 devstack cinder-volume[73008]: DEBUG oslo_service.periodic_task [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73008) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:03:10 devstack cinder-volume[73008]: DEBUG cinder.volume.drivers.lvm [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Updating volume stats {{(pid=73008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:03:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:10 devstack sudo[79168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:03:10 devstack sudo[79168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:10 devstack sudo[79168]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.439s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:10 devstack sudo[79180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:03:10 devstack sudo[79180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:11 devstack sudo[79180]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:11 devstack sudo[79186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:03:11 devstack sudo[79186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:11 devstack sudo[79186]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:03:11 devstack sudo[79190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:03:11 devstack sudo[79190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:03:11 devstack sudo[79190]: pam_unix(sudo:session): session closed for user root Apr 15 10:03:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:03:11 devstack cinder-volume[73008]: DEBUG cinder.manager [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Notifying Schedulers of capabilities ... {{(pid=73008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:03:32 devstack cinder-volume[73008]: DEBUG dbcounter [-] [73008] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=73008) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:04:10 devstack cinder-volume[73008]: DEBUG oslo_service.periodic_task [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73008) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:04:10 devstack cinder-volume[73008]: DEBUG cinder.volume.drivers.lvm [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Updating volume stats {{(pid=73008) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 15 10:04:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:10 devstack sudo[81327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 15 10:04:10 devstack sudo[81327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:10 devstack sudo[81327]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.474s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:10 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:10 devstack sudo[81331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:10 devstack sudo[81331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:11 devstack sudo[81331]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:11 devstack sudo[81345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 15 10:04:11 devstack sudo[81345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:11 devstack sudo[81345]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.501s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:11 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:11 devstack sudo[81349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 15 10:04:11 devstack sudo[81349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:12 devstack sudo[81349]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:12 devstack cinder-volume[73008]: DEBUG oslo_concurrency.processutils [None req-83196f74-62fc-4a44-a919-e523d066685a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.440s {{(pid=73008) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:12 devstack cinder-volume[73008]: DEBUG cinder.manager [None req-83196f74-62fc-4a44-a919-e523d066685a None None] Notifying Schedulers of capabilities ... {{(pid=73008) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:04:39 devstack cinder-volume[72902]: INFO oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Caught SIGTERM, stopping children Apr 15 10:04:39 devstack cinder-volume[72902]: DEBUG oslo_concurrency.lockutils [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Acquiring lock "singleton_lock" {{(pid=72902) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:04:39 devstack cinder-volume[72902]: DEBUG oslo_concurrency.lockutils [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Acquired lock "singleton_lock" {{(pid=72902) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:04:39 devstack cinder-volume[72902]: DEBUG oslo_concurrency.lockutils [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Releasing lock "singleton_lock" {{(pid=72902) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:04:39 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Stop services. {{(pid=72902) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 10:04:39 devstack cinder-volume[72902]: DEBUG oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Killing children. {{(pid=72902) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 10:04:39 devstack cinder-volume[72902]: INFO oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Waiting on 1 children to exit Apr 15 10:04:40 devstack cinder-volume[73008]: DEBUG oslo_concurrency.lockutils [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Acquiring lock "singleton_lock" {{(pid=73008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:04:40 devstack cinder-volume[73008]: DEBUG oslo_concurrency.lockutils [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Acquired lock "singleton_lock" {{(pid=73008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:04:40 devstack cinder-volume[73008]: DEBUG oslo_concurrency.lockutils [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Releasing lock "singleton_lock" {{(pid=73008) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:04:40 devstack cinder-volume[73008]: WARNING amqp [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:04:40 devstack cinder-volume[73008]: WARNING amqp [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:04:40 devstack cinder-volume[72902]: INFO oslo_service.backend._eventlet.service [None req-75ddd89c-6952-4a9f-9ed4-98d168e8b2f5 None None] Child 73008 exited with status 0 Apr 15 10:04:40 devstack cinder-volume[82069]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 10:04:40 devstack cinder-volume[82069]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:04:40 devstack cinder-volume[82069]: we strongly recommend against using it for new projects. Apr 15 10:04:40 devstack cinder-volume[82069]: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:04:40 devstack cinder-volume[82069]: framework. For more detail see Apr 15 10:04:40 devstack cinder-volume[82069]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:04:40 devstack cinder-volume[82069]: import eventlet # noqa Apr 15 10:04:42 devstack cinder-volume[82069]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82069) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:04:42 devstack cinder-volume[82069]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82069) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:04:42 devstack cinder-volume[82069]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82069) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:04:43 devstack cinder-volume[82069]: INFO dbcounter [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Registered counter for database cinder Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_db.sqlalchemy.engines [None req-1e09e839-89f8-430b-b301-3345b652197e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82069) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG dbcounter [-] [82069] Writer thread running {{(pid=82069) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:04:43 devstack cinder-volume[82069]: INFO cinder.rpc [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 10:04:43 devstack cinder-volume[82069]: INFO cinder.rpc [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_db.sqlalchemy.engines [None req-1e09e839-89f8-430b-b301-3345b652197e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82069) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:43 devstack cinder-volume[82069]: INFO cinder.volume.manager [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Determined volume DB was empty at startup. Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG cinder.volume.manager [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82069) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 10:04:43 devstack cinder-volume[82069]: INFO cinder.volume.manager [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 15 10:04:43 devstack cinder-volume[82069]: WARNING stevedore.named [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:04:43 devstack cinder-volume[82069]: WARNING castellan.key_manager [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:04:43 devstack cinder-volume[82069]: WARNING cinder.keymgr.conf_key_mgr [None req-1e09e839-89f8-430b-b301-3345b652197e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:04:43 devstack cinder-volume[82069]: INFO cinder.volume.manager [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_db.sqlalchemy.engines [None req-1e09e839-89f8-430b-b301-3345b652197e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82069) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:43 devstack cinder-volume[82069]: INFO oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Starting 1 workers Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Started child 82189 {{(pid=82069) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Full set of CONF: {{(pid=82069) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] ******************************************************************************** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Configuration options gathered from: {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] ================================================================================ {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] allow_availability_zone_fallback = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] allow_compression_on_image_upload = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] allowed_direct_url_schemes = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] api_rate_limit = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82189]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] auth_strategy = keystone {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_availability_zone = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_host = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_stats_polling_interval = 60 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backup_api_class = cinder.backup.api.API {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backup_name_template = backup-%s {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backup_use_same_host = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backup_use_temp_snapshot = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] chap_password = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] chap_username = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cinder_internal_tenant_project_id = c021911289f046518583ae8febd3bbcf {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cinder_internal_tenant_user_id = 823c690775b3445889dae808e8aff0a6 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cluster = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] compression_format = gzip {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] compute_api_class = cinder.compute.nova.API {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] config_dir = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] config_source = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] control_exchange = openstack {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] debug = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] default_availability_zone = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] default_group_type = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] default_volume_type = QuobyteHD {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] disk_geometry = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] driver_client_cert = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] driver_client_cert_key = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] driver_data_namespace = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] driver_ssl_cert_path = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] driver_ssl_cert_verify = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] driver_use_ssl = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] enable_new_services = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] enable_unsupported_driver = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] enabled_backends = ['QuobyteHD'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] enforce_multipath_for_image_xfer = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] filter_function = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_api_insecure = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_api_servers = ['http://192.168.122.189/image'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_api_ssl_compression = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_ca_certificates_file = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_catalog_info = image:glance:publicURL {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_certfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_keyfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_num_retries = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance_request_timeout = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] goodness_function = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] graceful_shutdown_timeout = 5 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] group_api_class = cinder.group.api.API {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] host = devstack {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_compress_on_upload = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_conversion_address_space_limit = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_conversion_cpu_limit = 60 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_conversion_disable = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_upload_use_cinder_backend = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_upload_use_internal_tenant = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_volume_cache_enabled = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_volume_cache_max_count = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] image_volume_cache_max_size_gb = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] init_host_max_objects_retrieval = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] instance_format = [instance: %(uuid)s] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] iscsi_target_flags = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] iscsi_write_cache = on {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] iser_helper = tgtadm {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] iser_ip_address = 192.168.122.189 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] iser_port = 3260 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] log_color = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] log_config_append = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] log_dir = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] log_file = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] log_options = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] log_rotate_interval = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] log_rotate_interval_type = days {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] log_rotation_type = none {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] max_age = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] max_logfile_count = 30 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] max_logfile_size_mb = 200 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] max_over_subscription_ratio = 20.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] message_reap_interval = 86400 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] message_ttl = 2592000 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82189]: INFO cinder.volume.manager [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] migration_create_volume_timeout_secs = 300 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.remotefs [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82189) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] monkey_patch = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] monkey_patch_modules = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] my_ip = 192.168.122.189 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] no_snapshot_gb_quota = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] num_iser_scan_tries = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] num_shell_tries = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] num_volume_device_scan_tries = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] nvmeof_conn_info_version = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] nvmet_ns_id = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] nvmet_port_id = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] osapi_max_limit = 1000 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] osapi_volume_ext_list = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] osapi_volume_listen = 0.0.0.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] osapi_volume_listen_port = 8776 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] osapi_volume_use_ssl = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] osapi_volume_workers = 2 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] per_volume_size_limit = -1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] periodic_fuzzy_delay = 60 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] periodic_interval = 60 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] project_id_regex = [0-9a-f\-]+ {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] public_endpoint = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] publish_errors = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] quota_backup_gigabytes = 1000 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] quota_backups = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] quota_gigabytes = 1000 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] quota_groups = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] quota_snapshots = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] quota_volumes = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] rate_limit_burst = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] rate_limit_except_level = CRITICAL {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] rate_limit_interval = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] reinit_driver_count = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] replication_device = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] report_discard_supported = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] report_interval = 120 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] reservation_clean_interval = 86400 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] reservation_expire = 86400 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] reserved_image_namespaces = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] reserved_percentage = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] rpc_response_timeout = 120 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] run_external_periodic_tasks = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] scst_target_driver = iscsi {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] scst_target_iqn_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_down_time = 720 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] shell_completion = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] snapshot_name_template = snapshot-%s {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] split_loggers = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] state_path = /opt/stack/data/cinder {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] storage_availability_zone = nova {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] storage_protocol = iSCSI {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] syslog_log_facility = LOG_USER {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] target_helper = lioadm {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] target_ip_address = 192.168.122.189 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] target_port = 3260 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] target_protocol = iscsi {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] target_secondary_ip_addresses = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] trace_flags = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] transfer_api_class = cinder.transfer.api.API {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] transport_url = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] until_refresh = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] use_chap_auth = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] use_default_quota_class = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] use_journal = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] use_json = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] use_multipath_for_image_xfer = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] use_stderr = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] use_syslog = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] verify_glance_signatures = enabled {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_api_class = cinder.volume.api.API {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_backend_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_clear = zero {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_clear_ionice = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_clear_size = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_copy_bps_limit = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_dd_blocksize = 1M {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_name_template = volume-%s {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_service_inithost_offload = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volume_usage_audit_period = month {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] zoning_mode = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_concurrency.disable_process_locking = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.admin_password = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.admin_token = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.admin_user = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.auth_admin_prefix = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.auth_port = 35357 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.auth_protocol = https {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.auth_section = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.auth_type = password {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.auth_uri = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.auth_version = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.cache = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.certfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.delay_auth_decision = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.http_connect_timeout = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.identity_uri = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.include_service_catalog = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.insecure = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.interface = public {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.keyfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_password = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcache_username = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.region_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.service_token_roles_required = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.service_type = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.token_cache_time = 300 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.backend = dogpile.cache.null {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.backend_argument = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.backend_expiration_time = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.config_prefix = cache.oslo {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.debug_cache_backend = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.enable_retry_client = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.enable_socket_keepalive = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.enabled = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.enforce_fips_mode = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.expiration_time = 600 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.hashclient_retry_attempts = 2 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.memcache_dead_retry = 300 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.memcache_pool_maxsize = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.memcache_sasl_enabled = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.password = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.proxies = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.redis_db = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.redis_sentinel_service_name = mymaster {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.redis_server = localhost:6379 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.retry_attempts = 2 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.retry_delay = 0.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.socket_keepalive_count = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.socket_keepalive_idle = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.socket_keepalive_interval = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.socket_timeout = 1.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.tls_allowed_ciphers = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.tls_cafile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.tls_certfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.tls_enabled = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.tls_keyfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cache.username = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] coordination.backend_url = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.asyncio_connection = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.asyncio_slave_connection = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.backend = sqlalchemy {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.connection = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.connection_debug = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.connection_parameters = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.connection_recycle_time = 3600 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.connection_trace = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.db_inc_retry_interval = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.db_max_retries = 20 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.db_max_retry_interval = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.db_retry_interval = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.max_overflow = 50 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.max_pool_size = 5 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.max_retries = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.mysql_wsrep_sync_wait = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.pool_timeout = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.retry_interval = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.slave_connection = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.sqlite_synchronous = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.synchronous_reader = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] database.use_db_reconnect = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82189) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.connection_string = messaging:// {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.enabled = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82189]: WARNING cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 10:04:43 devstack cinder-volume[82189]: WARNING cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.es_doc_type = notification {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.es_scroll_size = 10000 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.es_scroll_time = 2m {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.filter_error_trace = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.hmac_keys = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.sentinel_service_name = mymaster {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.socket_timeout = 0.1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.trace_requests = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler.trace_sqlalchemy = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Running cmd (subprocess): mount.quobyte {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler_jaeger.process_tags = {} {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler_jaeger.service_name_prefix = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] profiler_otlp.service_name_prefix = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.enforce_new_defaults = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: WARNING oslo_config.cfg [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.enforce_scope = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.policy_default_rule = default {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.policy_file = policy.yaml {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_policy.remote_timeout = 60.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] privsep_osbrick.group = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] privsep_osbrick.helper_command = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] privsep_osbrick.user = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cinder_sys_admin.group = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cinder_sys_admin.helper_command = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] cinder_sys_admin.user = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.auth_section = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.auth_type = password {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.cafile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.certfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.collect_timing = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.insecure = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.keyfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.send_service_user_token = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.split_loggers = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] service_user.timeout = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.auth_section = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.auth_type = password {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.certfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.collect_timing = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.insecure = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.keyfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.region_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.split_loggers = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] glance.timeout = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.backend_availability_zone = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.chap_password = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.chap_username = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.disk_geometry = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.driver_client_cert = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.driver_client_cert_key = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.driver_data_namespace = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.driver_use_ssl = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.enable_unsupported_driver = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.extra_capabilities = {} {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.filter_function = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.goodness_function = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.iscsi_target_flags = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.iscsi_write_cache = on {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.iser_helper = tgtadm {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.iser_port = 3260 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_host = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_login = admin {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_mount_options = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_password = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_private_key = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_share_path = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_ssh_port = 22 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.num_shell_tries = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.nvmet_port_id = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.quobyte_client_cfg = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.quobyte_volume_url = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.replication_device = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.report_discard_supported = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.reserved_percentage = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.scst_target_driver = iscsi {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.scst_target_iqn_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.storage_protocol = iSCSI {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.target_helper = tgtadm {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.target_port = 3260 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.target_protocol = iscsi {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.trace_flags = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.unique_fqdn_network = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.use_chap_auth = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.volume_backend_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.volume_clear = zero {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.volume_clear_ionice = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.volume_clear_size = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_reports.file_event_handler = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_reports.log_dir = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.backend_availability_zone = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.backend_host = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.chap_password = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.chap_username = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.chiscsi_conf = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.disk_geometry = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.driver_client_cert = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.driver_client_cert_key = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.driver_data_namespace = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.driver_use_ssl = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.extra_capabilities = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.filter_function = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.goodness_function = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.iscsi_target_flags = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.iscsi_write_cache = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.iser_helper = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.iser_ip_address = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.iser_port = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.iser_target_prefix = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_host = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_login = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_mount_options = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_password = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_private_key = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_share_path = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_ssh_port = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.num_shell_tries = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nvmet_ns_id = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.nvmet_port_id = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.replication_device = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.report_discard_supported = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.reserved_percentage = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.scst_target_driver = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.storage_protocol = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.target_helper = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.target_ip_address = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.target_port = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.target_prefix = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.target_protocol = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.trace_flags = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.unique_fqdn_network = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.use_chap_auth = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.volume_clear = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.volume_clear_ionice = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.volume_clear_size = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] QuobyteHD.volumes_dir = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.ssl = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.ssl_version = {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_notifications.driver = [] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_notifications.retry = -1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] oslo_messaging_notifications.transport_url = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack quobyte-client[82190]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] key_manager.fixed_key = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack quobyte-client[82190]: Invalid parameters found, error: missing mount point. Apr 15 10:04:43 devstack quobyte-client[82190]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 10:04:43 devstack quobyte-client[82190]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.barbican_api_version = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.barbican_endpoint = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.barbican_endpoint_type = public {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.barbican_region_name = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.cafile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.certfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.collect_timing = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.insecure = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.keyfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.number_of_retries = 60 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.retry_delay = 1 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.send_service_user_token = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.split_loggers = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.timeout = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.verify_ssl = True {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican.verify_ssl_path = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican_service_user.auth_section = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican_service_user.auth_type = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican_service_user.cafile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] CMD "mount.quobyte" returned: 1 in 0.088s {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican_service_user.certfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican_service_user.collect_timing = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican_service_user.insecure = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican_service_user.keyfile = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican_service_user.split_loggers = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] barbican_service_user.timeout = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.approle_role_id = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82189]: INFO cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c ... Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.approle_secret_id = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.kv_mountpoint = secret {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de -c /etc/quobyte/client-cinder.cfg {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.kv_path = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.kv_version = 2 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.namespace = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.root_token_id = **** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.ssl_ca_crt_file = None {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.timeout = 60.0 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.use_ssl = False {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:43 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] ******************************************************************************** {{(pid=82069) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 10:04:43 devstack sudo[82191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de -c /etc/quobyte/client-cinder.cfg Apr 15 10:04:43 devstack sudo[82191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:44 devstack sudo[82191]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.510s {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:44 devstack cinder-volume[82189]: INFO cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c succeeded Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.517s {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:44 devstack sudo[82260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:04:44 devstack sudo[82260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:44 devstack sudo[82260]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.475s {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:44 devstack cinder-volume[82189]: INFO cinder.volume.driver [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG cinder.volume.driver [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6867942810059, 'free_capacity_gb': 1775.6867942810059, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82189) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG oslo_db.sqlalchemy.engines [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82189) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG dbcounter [-] [82189] Writer thread running {{(pid=82189) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG cinder.db.sqlalchemy.api [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Building query based on filter {{(pid=82189) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG cinder.image.image_utils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82189) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 10:04:44 devstack cinder-volume[82189]: INFO cinder.keymgr.migration [None req-9510f736-93d5-431a-ab21-bfa4b845d5b7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:44 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:44 devstack sudo[82263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:04:44 devstack sudo[82263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:45 devstack sudo[82263]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.470s {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG cinder.manager [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Notifying Schedulers of capabilities ... {{(pid=82189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:04:45 devstack cinder-volume[82189]: INFO cinder.volume.manager [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Driver initialization completed successfully. Apr 15 10:04:45 devstack cinder-volume[82189]: INFO cinder.manager [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Initiating service 3 cleanup Apr 15 10:04:45 devstack cinder-volume[82189]: INFO cinder.manager [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Service 3 cleanup completed. Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG cinder.service [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Creating RPC server for service cinder-volume {{(pid=82189) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG cinder.service [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82189) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 10:04:45 devstack cinder-volume[82189]: INFO cinder.volume.manager [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.quobyte [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:45 devstack sudo[82269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:04:45 devstack sudo[82269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:45 devstack sudo[82269]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:45 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.467s {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:45 devstack cinder-volume[82189]: INFO cinder.volume.manager [None req-ce299e0a-4df7-4fa7-9608-063cc73f9f40 None None] Driver post RPC initialization completed successfully. Apr 15 10:04:48 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-af8cd65a-f51c-4c78-817d-9609d0a1d7fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:48 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-af8cd65a-f51c-4c78-817d-9609d0a1d7fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:48 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.quobyte [None req-af8cd65a-f51c-4c78-817d-9609d0a1d7fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82189) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:48 devstack cinder-volume[82189]: DEBUG cinder.volume.drivers.quobyte [None req-af8cd65a-f51c-4c78-817d-9609d0a1d7fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82189) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:48 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-af8cd65a-f51c-4c78-817d-9609d0a1d7fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82189) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:48 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-af8cd65a-f51c-4c78-817d-9609d0a1d7fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:48 devstack sudo[82333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:04:48 devstack sudo[82333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:49 devstack sudo[82333]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:49 devstack cinder-volume[82189]: DEBUG oslo_concurrency.processutils [None req-af8cd65a-f51c-4c78-817d-9609d0a1d7fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.403s {{(pid=82189) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:49 devstack cinder-volume[82189]: DEBUG cinder.manager [None req-af8cd65a-f51c-4c78-817d-9609d0a1d7fd None None] Notifying Schedulers of capabilities ... {{(pid=82189) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:04:50 devstack cinder-volume[82069]: INFO oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Caught SIGTERM, stopping children Apr 15 10:04:50 devstack cinder-volume[82069]: DEBUG oslo_concurrency.lockutils [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Acquiring lock "singleton_lock" {{(pid=82069) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:04:50 devstack cinder-volume[82069]: DEBUG oslo_concurrency.lockutils [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Acquired lock "singleton_lock" {{(pid=82069) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:04:50 devstack cinder-volume[82069]: DEBUG oslo_concurrency.lockutils [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Releasing lock "singleton_lock" {{(pid=82069) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:04:50 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Stop services. {{(pid=82069) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 15 10:04:50 devstack cinder-volume[82069]: DEBUG oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Killing children. {{(pid=82069) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 15 10:04:50 devstack cinder-volume[82069]: INFO oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Waiting on 1 children to exit Apr 15 10:04:53 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Acquiring lock "singleton_lock" {{(pid=82189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:04:53 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Acquired lock "singleton_lock" {{(pid=82189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:04:53 devstack cinder-volume[82189]: DEBUG oslo_concurrency.lockutils [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Releasing lock "singleton_lock" {{(pid=82189) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:04:53 devstack cinder-volume[82189]: WARNING amqp [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:04:53 devstack cinder-volume[82189]: WARNING amqp [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 15 10:04:53 devstack cinder-volume[82069]: INFO oslo_service.backend._eventlet.service [None req-1e09e839-89f8-430b-b301-3345b652197e None None] Child 82189 exited with status 0 Apr 15 10:04:53 devstack cinder-volume[82422]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 15 10:04:53 devstack cinder-volume[82422]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:04:53 devstack cinder-volume[82422]: we strongly recommend against using it for new projects. Apr 15 10:04:53 devstack cinder-volume[82422]: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:04:53 devstack cinder-volume[82422]: framework. For more detail see Apr 15 10:04:53 devstack cinder-volume[82422]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:04:53 devstack cinder-volume[82422]: import eventlet # noqa Apr 15 10:04:55 devstack cinder-volume[82422]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82422) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 15 10:04:55 devstack cinder-volume[82422]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82422) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 15 10:04:55 devstack cinder-volume[82422]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82422) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 15 10:04:56 devstack cinder-volume[82422]: INFO dbcounter [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Registered counter for database cinder Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82422) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG dbcounter [-] [82422] Writer thread running {{(pid=82422) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:04:56 devstack cinder-volume[82422]: INFO cinder.rpc [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 15 10:04:56 devstack cinder-volume[82422]: INFO cinder.rpc [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82422) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:56 devstack cinder-volume[82422]: INFO cinder.volume.manager [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Determined volume DB was empty at startup. Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG cinder.volume.manager [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82422) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 15 10:04:56 devstack cinder-volume[82422]: WARNING stevedore.named [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 15 10:04:56 devstack cinder-volume[82422]: WARNING castellan.key_manager [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:04:56 devstack cinder-volume[82422]: WARNING cinder.keymgr.conf_key_mgr [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 15 10:04:56 devstack cinder-volume[82422]: INFO cinder.volume.manager [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_db.sqlalchemy.engines [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82422) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:56 devstack cinder-volume[82422]: INFO oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Starting 1 workers Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Started child 82600 {{(pid=82422) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Full set of CONF: {{(pid=82422) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] ******************************************************************************** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Configuration options gathered from: {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] ================================================================================ {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] allow_availability_zone_fallback = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] allow_compression_on_image_upload = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82600]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] allowed_direct_url_schemes = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] api_rate_limit = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] auth_strategy = keystone {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_availability_zone = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_host = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_stats_polling_interval = 60 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backup_api_class = cinder.backup.api.API {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backup_name_template = backup-%s {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backup_use_same_host = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backup_use_temp_snapshot = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] chap_password = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] chap_username = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cinder_internal_tenant_project_id = c021911289f046518583ae8febd3bbcf {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cinder_internal_tenant_user_id = 823c690775b3445889dae808e8aff0a6 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cluster = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] compression_format = gzip {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] compute_api_class = cinder.compute.nova.API {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] config_dir = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] config_source = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] control_exchange = openstack {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] debug = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] default_availability_zone = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] default_group_type = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] default_volume_type = QuobyteHD {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] disk_geometry = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] driver_client_cert = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] driver_client_cert_key = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] driver_data_namespace = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] driver_ssl_cert_path = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] driver_ssl_cert_verify = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] driver_use_ssl = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] enable_new_services = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] enable_unsupported_driver = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] enabled_backends = ['QuobyteHD'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] enforce_multipath_for_image_xfer = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] filter_function = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_api_insecure = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_api_servers = ['http://192.168.122.189/image'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_api_ssl_compression = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_ca_certificates_file = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_catalog_info = image:glance:publicURL {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_certfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_keyfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_num_retries = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance_request_timeout = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] goodness_function = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] graceful_shutdown_timeout = 5 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] group_api_class = cinder.group.api.API {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] host = devstack {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_compress_on_upload = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_conversion_address_space_limit = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_conversion_cpu_limit = 60 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_conversion_disable = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_upload_use_cinder_backend = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_upload_use_internal_tenant = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_volume_cache_enabled = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_volume_cache_max_count = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] image_volume_cache_max_size_gb = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] init_host_max_objects_retrieval = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] instance_format = [instance: %(uuid)s] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] iscsi_target_flags = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] iscsi_write_cache = on {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] iser_helper = tgtadm {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] iser_ip_address = 192.168.122.189 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] iser_port = 3260 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] log_color = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] log_config_append = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] log_dir = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] log_file = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] log_options = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] log_rotate_interval = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] log_rotate_interval_type = days {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] log_rotation_type = none {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] max_age = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] max_logfile_count = 30 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] max_logfile_size_mb = 200 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] max_over_subscription_ratio = 20.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] message_reap_interval = 86400 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] message_ttl = 2592000 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] migration_create_volume_timeout_secs = 300 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] monkey_patch = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] monkey_patch_modules = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] my_ip = 192.168.122.189 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] no_snapshot_gb_quota = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] num_iser_scan_tries = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] num_shell_tries = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] num_volume_device_scan_tries = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] nvmeof_conn_info_version = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] nvmet_ns_id = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] nvmet_port_id = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] osapi_max_limit = 1000 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] osapi_volume_ext_list = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] osapi_volume_listen = 0.0.0.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] osapi_volume_listen_port = 8776 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] osapi_volume_use_ssl = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] osapi_volume_workers = 2 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] per_volume_size_limit = -1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] periodic_fuzzy_delay = 60 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] periodic_interval = 60 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] project_id_regex = [0-9a-f\-]+ {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] public_endpoint = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] publish_errors = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] quota_backup_gigabytes = 1000 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] quota_backups = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] quota_gigabytes = 1000 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] quota_groups = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] quota_snapshots = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] quota_volumes = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] rate_limit_burst = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] rate_limit_except_level = CRITICAL {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] rate_limit_interval = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] reinit_driver_count = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] replication_device = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] report_discard_supported = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] report_interval = 120 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] reservation_clean_interval = 86400 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] reservation_expire = 86400 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] reserved_image_namespaces = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] reserved_percentage = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] rpc_response_timeout = 120 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] run_external_periodic_tasks = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] scst_target_driver = iscsi {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] scst_target_iqn_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_down_time = 720 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] shell_completion = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] snapshot_name_template = snapshot-%s {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82600) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] split_loggers = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] state_path = /opt/stack/data/cinder {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] storage_availability_zone = nova {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] storage_protocol = iSCSI {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] syslog_log_facility = LOG_USER {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] target_helper = lioadm {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] target_ip_address = 192.168.122.189 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] target_port = 3260 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] target_protocol = iscsi {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] target_secondary_ip_addresses = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] trace_flags = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] transfer_api_class = cinder.transfer.api.API {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] transport_url = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] until_refresh = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] use_chap_auth = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] use_default_quota_class = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] use_journal = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] use_json = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] use_multipath_for_image_xfer = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] use_stderr = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] use_syslog = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] verify_glance_signatures = enabled {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_api_class = cinder.volume.api.API {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_backend_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_clear = zero {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_clear_ionice = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_clear_size = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_copy_bps_limit = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_dd_blocksize = 1M {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_name_template = volume-%s {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_service_inithost_offload = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volume_usage_audit_period = month {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] zoning_mode = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_concurrency.disable_process_locking = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.admin_password = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.admin_token = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.admin_user = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.auth_admin_prefix = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.auth_port = 35357 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.auth_protocol = https {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.auth_section = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.auth_type = password {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.auth_uri = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.auth_version = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.cache = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.certfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.delay_auth_decision = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.http_connect_timeout = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.identity_uri = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.include_service_catalog = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.insecure = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.interface = public {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.keyfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_password = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcache_username = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.region_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.service_token_roles_required = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.service_type = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.token_cache_time = 300 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.189/identity {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.backend = dogpile.cache.null {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.backend_argument = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.backend_expiration_time = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.config_prefix = cache.oslo {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.debug_cache_backend = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.enable_retry_client = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.enable_socket_keepalive = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.enabled = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.enforce_fips_mode = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.expiration_time = 600 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.hashclient_retry_attempts = 2 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.memcache_dead_retry = 300 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.memcache_pool_maxsize = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.memcache_sasl_enabled = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.password = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.proxies = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.redis_db = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.redis_sentinel_service_name = mymaster {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.redis_server = localhost:6379 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.retry_attempts = 2 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.retry_delay = 0.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.socket_keepalive_count = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.socket_keepalive_idle = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.socket_keepalive_interval = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.socket_timeout = 1.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.tls_allowed_ciphers = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.tls_cafile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.tls_certfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.tls_enabled = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.tls_keyfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cache.username = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] coordination.backend_url = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.asyncio_connection = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.asyncio_slave_connection = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.backend = sqlalchemy {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.connection = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.connection_debug = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.connection_parameters = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.connection_recycle_time = 3600 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.connection_trace = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.db_inc_retry_interval = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.db_max_retries = 20 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.db_max_retry_interval = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.db_retry_interval = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.max_overflow = 50 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.max_pool_size = 5 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.max_retries = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.mysql_wsrep_sync_wait = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.pool_timeout = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.retry_interval = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.slave_connection = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.sqlite_synchronous = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.synchronous_reader = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] database.use_db_reconnect = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.connection_string = messaging:// {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.enabled = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.es_doc_type = notification {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.es_scroll_size = 10000 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.es_scroll_time = 2m {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.filter_error_trace = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.hmac_keys = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.sentinel_service_name = mymaster {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.socket_timeout = 0.1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.trace_requests = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler.trace_sqlalchemy = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler_jaeger.process_tags = {} {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler_jaeger.service_name_prefix = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] profiler_otlp.service_name_prefix = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.enforce_new_defaults = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: WARNING oslo_config.cfg [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.enforce_scope = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.policy_default_rule = default {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.policy_file = policy.yaml {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_policy.remote_timeout = 60.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] privsep_osbrick.group = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] privsep_osbrick.helper_command = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] privsep_osbrick.user = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cinder_sys_admin.group = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cinder_sys_admin.helper_command = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] cinder_sys_admin.user = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.auth_section = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.auth_type = password {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.cafile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.certfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.collect_timing = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.insecure = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.keyfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.send_service_user_token = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.split_loggers = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] service_user.timeout = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.auth_section = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.auth_type = password {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.certfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.collect_timing = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.insecure = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.keyfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.region_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.split_loggers = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] glance.timeout = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.backend_availability_zone = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.chap_password = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.chap_username = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.disk_geometry = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.driver_client_cert = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.driver_client_cert_key = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.driver_data_namespace = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.driver_use_ssl = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.enable_unsupported_driver = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.extra_capabilities = {} {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.filter_function = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.goodness_function = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.iscsi_target_flags = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.iscsi_write_cache = on {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.iser_helper = tgtadm {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.iser_ip_address = 192.168.122.189 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.iser_port = 3260 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_host = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_login = admin {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_mount_options = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_password = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_private_key = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_share_path = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_ssh_port = 22 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.num_shell_tries = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.nvmet_port_id = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.quobyte_client_cfg = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.quobyte_volume_url = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.replication_device = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.report_discard_supported = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.reserved_percentage = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.scst_target_driver = iscsi {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.scst_target_iqn_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.storage_protocol = iSCSI {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.target_helper = tgtadm {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.target_ip_address = 192.168.122.189 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.target_port = 3260 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.target_protocol = iscsi {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.trace_flags = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.unique_fqdn_network = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.use_chap_auth = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.volume_backend_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.volume_clear = zero {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.volume_clear_ionice = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.volume_clear_size = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82600) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.quobyte [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_reports.file_event_handler = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.quobyte [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_reports.log_dir = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.backend_availability_zone = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.backend_host = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Running cmd (subprocess): mount.quobyte {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.chap_password = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.chap_username = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.chiscsi_conf = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.disk_geometry = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.driver_client_cert = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.driver_client_cert_key = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.driver_data_namespace = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.driver_use_ssl = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.extra_capabilities = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.filter_function = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.goodness_function = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.iscsi_target_flags = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.iscsi_write_cache = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.iser_helper = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.iser_ip_address = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.iser_port = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.iser_target_prefix = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_host = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_login = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_mount_options = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_password = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_private_key = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_share_path = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_ssh_port = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.num_shell_tries = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nvmet_ns_id = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.nvmet_port_id = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.replication_device = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.report_discard_supported = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.reserved_percentage = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.scst_target_driver = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.storage_protocol = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.target_helper = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.target_ip_address = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.target_port = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.target_prefix = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.target_protocol = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.trace_flags = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.unique_fqdn_network = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.use_chap_auth = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.volume_clear = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.volume_clear_ionice = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.volume_clear_size = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] QuobyteHD.volumes_dir = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.ssl = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.ssl_version = {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_notifications.driver = [] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_notifications.retry = -1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] oslo_messaging_notifications.transport_url = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] key_manager.fixed_key = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.barbican_api_version = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.barbican_endpoint = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.barbican_endpoint_type = public {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.barbican_region_name = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.cafile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.certfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.collect_timing = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.insecure = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.keyfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.number_of_retries = 60 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.retry_delay = 1 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.send_service_user_token = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.split_loggers = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.timeout = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.verify_ssl = True {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican.verify_ssl_path = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican_service_user.auth_section = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican_service_user.auth_type = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican_service_user.cafile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican_service_user.certfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican_service_user.collect_timing = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican_service_user.insecure = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican_service_user.keyfile = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican_service_user.split_loggers = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] barbican_service_user.timeout = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.approle_role_id = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.approle_secret_id = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.kv_mountpoint = secret {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.kv_path = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.kv_version = 2 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.namespace = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.root_token_id = **** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.ssl_ca_crt_file = None {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.timeout = 60.0 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.use_ssl = False {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 15 10:04:56 devstack cinder-volume[82422]: DEBUG oslo_service.backend._eventlet.service [None req-1f4f3ed0-9898-40ce-8af5-9c601c7dc05c None None] ******************************************************************************** {{(pid=82422) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 15 10:04:56 devstack quobyte-client[82613]: Reading configuration file: /etc/quobyte/client.cfg Apr 15 10:04:56 devstack quobyte-client[82613]: Invalid parameters found, error: missing mount point. Apr 15 10:04:56 devstack quobyte-client[82613]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 15 10:04:56 devstack quobyte-client[82613]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] CMD "mount.quobyte" returned: 1 in 0.060s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:56 devstack sudo[82635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:04:56 devstack sudo[82635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:57 devstack sudo[82635]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.497s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:57 devstack cinder-volume[82600]: INFO cinder.volume.driver [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Driver hasn't implemented _init_vendor_properties() Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.volume.driver [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710105895996, 'free_capacity_gb': 1775.710105895996, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82600) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_db.sqlalchemy.engines [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writer thread running {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.db.sqlalchemy.api [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Building query based on filter {{(pid=82600) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82600) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:57 devstack cinder-volume[82600]: INFO cinder.keymgr.migration [None req-00736f94-ecee-41b3-92b4-ec0679da432f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 15 10:04:57 devstack sudo[82681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:04:57 devstack sudo[82681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:57 devstack sudo[82681]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.388s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:04:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Driver initialization completed successfully. Apr 15 10:04:57 devstack cinder-volume[82600]: INFO cinder.manager [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Initiating service 3 cleanup Apr 15 10:04:57 devstack cinder-volume[82600]: INFO cinder.manager [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Service 3 cleanup completed. Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.service [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Creating RPC server for service cinder-volume {{(pid=82600) start /opt/stack/cinder/cinder/service.py:231}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.service [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82600) start /opt/stack/cinder/cinder/service.py:237}} Apr 15 10:04:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:04:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:04:57 devstack sudo[82695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:04:57 devstack sudo[82695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:04:58 devstack sudo[82695]: pam_unix(sudo:session): session closed for user root Apr 15 10:04:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.399s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:04:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-38b819e3-7776-4398-85c2-32f88fc35062 None None] Driver post RPC initialization completed successfully. Apr 15 10:05:06 devstack cinder-volume[82422]: DEBUG dbcounter [-] [82422] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82422) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:05:07 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=2 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:05:08 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:06:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:06:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:10 devstack sudo[83241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:06:10 devstack sudo[83241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:11 devstack sudo[83241]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.121s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:11 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:12 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Flow 'volume_create_manager' (34cc948f-02c9-4097-9d63-6b65889752b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1feeb8-4237-4a43-955d-88da1f57cdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b1feeb8-4237-4a43-955d-88da1f57cdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-751970195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e666e216-5f36-46be-b1c5-ea05864871d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89033c1ea7c64a569e40282290a5d66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:13Z,use_quota=True,user_id='551a80d1c0654c9c9836b1bfa3b8f0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30abd7d4-409a-48ca-b8fd-a80c2c9b93d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30abd7d4-409a-48ca-b8fd-a80c2c9b93d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a936c2a4-9e9e-402e-aff7-4b1098add42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a936c2a4-9e9e-402e-aff7-4b1098add42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e666e216-5f36-46be-b1c5-ea05864871d3', 'volume_name': 'volume-e666e216-5f36-46be-b1c5-ea05864871d3', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b716db4-383d-4889-91bd-880151b55751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b716db4-383d-4889-91bd-880151b55751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dee025-2dbf-4277-8d28-1a7a5e9970b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:13 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Volume e666e216-5f36-46be-b1c5-ea05864871d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e666e216-5f36-46be-b1c5-ea05864871d3', 'volume_size': 1} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-751970195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e666e216-5f36-46be-b1c5-ea05864871d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89033c1ea7c64a569e40282290a5d66c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:13Z,use_quota=True,user_id='551a80d1c0654c9c9836b1bfa3b8f0a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Creating volume e666e216-5f36-46be-b1c5-ea05864871d3 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:13 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:06:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:13 devstack sudo[83259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3 1073741824 Apr 15 10:06:13 devstack sudo[83259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:16 devstack sudo[83259]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3 1073741824" returned: 0 in 3.680s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:17 devstack sudo[83656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3 Apr 15 10:06:17 devstack sudo[83656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:18 devstack sudo[83656]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3" returned: 0 in 1.309s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] <== create_volume: return (5144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 5.146s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88dee025-2dbf-4277-8d28-1a7a5e9970b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e666e216-5f36-46be-b1c5-ea05864871d3', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744a36f5-c3b4-4178-b0ac-d40dd7add8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:18 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Volume volume-e666e216-5f36-46be-b1c5-ea05864871d3 (e666e216-5f36-46be-b1c5-ea05864871d3): created successfully Apr 15 10:06:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744a36f5-c3b4-4178-b0ac-d40dd7add8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Flow 'volume_create_manager' (34cc948f-02c9-4097-9d63-6b65889752b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:18 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-974bf769-29c6-4527-917e-19755281fa6f tempest-VolumesAdminNegativeTest-997007796 None] Created volume successfully. Apr 15 10:06:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Acquiring lock "cinder-e666e216-5f36-46be-b1c5-ea05864871d3-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Lock "cinder-e666e216-5f36-46be-b1c5-ea05864871d3-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Acquiring lock "cinder-quobyte-e666e216-5f36-46be-b1c5-ea05864871d3" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Lock "cinder-quobyte-e666e216-5f36-46be-b1c5-ea05864871d3" acquired by "delete_volume" :: waited 0.053s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:19 devstack cinder-volume[82600]: INFO oslo.privsep.daemon [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpo8njiwnh/privsep.sock'] Apr 15 10:06:19 devstack sudo[83665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpo8njiwnh/privsep.sock Apr 15 10:06:19 devstack sudo[83665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:20 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 15 10:06:20 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:06:20 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 10:06:20 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:06:20 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:06:20 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 10:06:20 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:06:20 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:06:20 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 15 10:06:21 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 15 10:06:21 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 15 10:06:21 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 15 10:06:21 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:06:21 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 15 10:06:21 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 15 10:06:21 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 15 10:06:21 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: Apr 15 10:06:21 devstack cinder-volume[82600]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 15 10:06:22 devstack sudo[83665]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:22 devstack cinder-volume[82600]: INFO oslo.privsep.daemon [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Spawned new privsep daemon via rootwrap Apr 15 10:06:22 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Accepted privsep connection to /tmp/tmpo8njiwnh/privsep.sock {{(pid=82600) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 15 10:06:22 devstack cinder-volume[82600]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 15 10:06:22 devstack cinder-volume[82600]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 15 10:06:22 devstack cinder-volume[82600]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 15 10:06:22 devstack cinder-volume[82600]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83676 Apr 15 10:06:22 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20bf4fa-7e8a-41ce-8bc6-102b3af1640c]: (2,) {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f837f47e-1dc9-46c9-8477-b6fafdaebc96]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:23 devstack sudo[83683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3 Apr 15 10:06:23 devstack sudo[83683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Flow 'volume_create_manager' (742fa6bb-cd17-4cc3-885d-4f4e720e1861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c3fb17-ba29-44a7-8fa4-5315965b7d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c3fb17-ba29-44a7-8fa4-5315965b7d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-792208608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e2229b-cd74-4107-8804-5544844064ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f85bcf563f5462cb49eb5213850a851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:24Z,use_quota=True,user_id='be96f66144ba4e17a02fd1c658bf20f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbbe5ce-a445-44e5-bab2-c3a5464d34db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfbbe5ce-a445-44e5-bab2-c3a5464d34db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4d39f6-86df-4224-8def-77b9409ab005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed4d39f6-86df-4224-8def-77b9409ab005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28e2229b-cd74-4107-8804-5544844064ea', 'volume_name': 'volume-28e2229b-cd74-4107-8804-5544844064ea', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963bc483-6865-4449-b6a6-667b43117920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963bc483-6865-4449-b6a6-667b43117920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e32c668-45ad-44cc-8635-bb92ab645342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:23 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Volume 28e2229b-cd74-4107-8804-5544844064ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28e2229b-cd74-4107-8804-5544844064ea', 'volume_size': 1} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-792208608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28e2229b-cd74-4107-8804-5544844064ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f85bcf563f5462cb49eb5213850a851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:24Z,use_quota=True,user_id='be96f66144ba4e17a02fd1c658bf20f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Creating volume 28e2229b-cd74-4107-8804-5544844064ea {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:23 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:06:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:23 devstack sudo[83686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea 1073741824 Apr 15 10:06:23 devstack sudo[83686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:24 devstack sudo[83683]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3" returned: 0 in 1.526s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:24 devstack sudo[83693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3 Apr 15 10:06:24 devstack sudo[83693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:25 devstack sudo[83693]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e666e216-5f36-46be-b1c5-ea05864871d3" returned: 0 in 0.794s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Lock "cinder-quobyte-e666e216-5f36-46be-b1c5-ea05864871d3" released by "delete_volume" :: held 5.727s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:25 devstack sudo[83686]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea 1073741824" returned: 0 in 1.548s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:25 devstack sudo[83701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea Apr 15 10:06:25 devstack sudo[83701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:25 devstack cinder-volume[82600]: WARNING cinder.quota [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:25 devstack cinder-volume[82600]: WARNING cinder.quota [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:06:25 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Created reservations ['49cbcd23-a08a-429f-ae5d-b2d2e9667aa5', 'cdf5f29d-9249-457b-bac6-6f0ec16cda1e', '08038eb7-3c03-4a62-8fcf-852d6aff7125', '443e2755-0878-4585-a550-6f33d56a742b'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:26 devstack sudo[83703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:06:26 devstack sudo[83703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:27 devstack sudo[83701]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea" returned: 0 in 1.538s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] <== create_volume: return (3177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.183s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e32c668-45ad-44cc-8635-bb92ab645342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28e2229b-cd74-4107-8804-5544844064ea', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78a979a-8050-40ac-aae9-eac1e225f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:27 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Volume volume-28e2229b-cd74-4107-8804-5544844064ea (28e2229b-cd74-4107-8804-5544844064ea): created successfully Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c78a979a-8050-40ac-aae9-eac1e225f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Flow 'volume_create_manager' (742fa6bb-cd17-4cc3-885d-4f4e720e1861) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:27 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-83c3fefb-d723-4152-959e-4be80ff30704 tempest-ServersNegativeTestJSON-1662516059 None] Created volume successfully. Apr 15 10:06:27 devstack sudo[83703]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.460s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:27 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Deleted volume successfully. Apr 15 10:06:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a005161e-b9b1-477e-92aa-899e7af3509d tempest-VolumesAdminNegativeTest-997007796 None] Lock "cinder-e666e216-5f36-46be-b1c5-ea05864871d3-delete_volume" released by "delete_volume" :: held 8.059s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Flow 'volume_create_manager' (b949e4e0-fc55-411f-972e-2769a492eb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773c59d9-bb5b-4498-9c31-02b044452a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773c59d9-bb5b-4498-9c31-02b044452a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:32Z,deleted=False,deleted_at=None,display_description='',display_name='a52b5656-190b-4b41-84c6-3f40271238ce-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff5df33-2017-4106-ba94-d1a2c81a5841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2520ad0ad1ee4678a4b520b6d1723f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:32Z,use_quota=True,user_id='baf60878e7b24875ae2c67810b2ad186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ebe4a4-adcd-47dc-a644-a9773cfefae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76ebe4a4-adcd-47dc-a644-a9773cfefae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73f3d87-2747-4fc3-a08e-e0f80922bdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c73f3d87-2747-4fc3-a08e-e0f80922bdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff5df33-2017-4106-ba94-d1a2c81a5841', 'volume_name': 'volume-cff5df33-2017-4106-ba94-d1a2c81a5841', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc7e521-1002-48a3-a0a7-dd9bcf049451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc7e521-1002-48a3-a0a7-dd9bcf049451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16820ed7-40cc-4864-8eb4-d48f830dfe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Volume cff5df33-2017-4106-ba94-d1a2c81a5841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff5df33-2017-4106-ba94-d1a2c81a5841', 'volume_size': 1} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:32Z,deleted=False,deleted_at=None,display_description='',display_name='a52b5656-190b-4b41-84c6-3f40271238ce-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff5df33-2017-4106-ba94-d1a2c81a5841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2520ad0ad1ee4678a4b520b6d1723f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:32Z,use_quota=True,user_id='baf60878e7b24875ae2c67810b2ad186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Creating volume cff5df33-2017-4106-ba94-d1a2c81a5841 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:32 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:32 devstack sudo[83782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 1073741824 Apr 15 10:06:32 devstack sudo[83782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Flow 'volume_create_manager' (c39d798d-9667-4bc5-840a-e6c386ae4b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844c9c19-40c7-4ae7-ad6e-1b6aef5f829e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (844c9c19-40c7-4ae7-ad6e-1b6aef5f829e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-475026971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbd48f2-9bbd-4b12-95b8-fb85b25798c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f85bcf563f5462cb49eb5213850a851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:33Z,use_quota=True,user_id='be96f66144ba4e17a02fd1c658bf20f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ef2cdf-1fa3-41bc-a80f-cf4de1bbe45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ef2cdf-1fa3-41bc-a80f-cf4de1bbe45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e26bd52-1c24-4a68-b255-77e2797091a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e26bd52-1c24-4a68-b255-77e2797091a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdbd48f2-9bbd-4b12-95b8-fb85b25798c2', 'volume_name': 'volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcd1272-9030-4b16-99e5-f0d0ec097a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcd1272-9030-4b16-99e5-f0d0ec097a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cc419d-8143-4285-9866-961ddabb5a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:32 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Volume cdbd48f2-9bbd-4b12-95b8-fb85b25798c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2', 'volume_size': 1} Apr 15 10:06:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:33 devstack sudo[83782]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 1073741824" returned: 0 in 1.070s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:33 devstack sudo[83796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 Apr 15 10:06:33 devstack sudo[83796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:34 devstack sudo[83796]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841" returned: 0 in 0.662s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.228s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-475026971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdbd48f2-9bbd-4b12-95b8-fb85b25798c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f85bcf563f5462cb49eb5213850a851',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:33Z,use_quota=True,user_id='be96f66144ba4e17a02fd1c658bf20f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Creating volume cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:34 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:34 devstack sudo[83809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 1073741824 Apr 15 10:06:34 devstack sudo[83809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16820ed7-40cc-4864-8eb4-d48f830dfe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff5df33-2017-4106-ba94-d1a2c81a5841', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8afa858-4e20-4657-94dd-1069786c57de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:34 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Volume volume-cff5df33-2017-4106-ba94-d1a2c81a5841 (cff5df33-2017-4106-ba94-d1a2c81a5841): created successfully Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8afa858-4e20-4657-94dd-1069786c57de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Flow 'volume_create_manager' (b949e4e0-fc55-411f-972e-2769a492eb6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:34 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-2ad93d37-4e82-440c-9aa2-f3fbcbc9a201 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Created volume successfully. Apr 15 10:06:35 devstack sudo[83809]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 1073741824" returned: 0 in 0.933s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:35 devstack sudo[83865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 Apr 15 10:06:35 devstack sudo[83865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:36 devstack sudo[83865]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2" returned: 0 in 1.290s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.296s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cc419d-8143-4285-9866-961ddabb5a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eb84cb-5974-43f5-8bbc-8ee2f57d9182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:36 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Volume volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 (cdbd48f2-9bbd-4b12-95b8-fb85b25798c2): created successfully Apr 15 10:06:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8eb84cb-5974-43f5-8bbc-8ee2f57d9182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Flow 'volume_create_manager' (c39d798d-9667-4bc5-840a-e6c386ae4b6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:36 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-731d726b-8d4e-4c8d-8441-d35947c73d89 tempest-ServersNegativeTestJSON-1662516059 None] Created volume successfully. Apr 15 10:06:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "cinder-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Lock "cinder-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "cinder-quobyte-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Lock "cinder-quobyte-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2" acquired by "delete_volume" :: waited 0.040s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:38 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1ff1d7-8c01-436b-ad33-e670262c3271]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:39 devstack sudo[83907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 Apr 15 10:06:39 devstack sudo[83907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:40 devstack cinder-volume[82600]: WARNING py.warnings [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-749db045-720c-4875-bc46-b41e5536ca03 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 15 10:06:40 devstack cinder-volume[82600]: .first() Apr 15 10:06:40 devstack cinder-volume[82600]: Apr 15 10:06:40 devstack sudo[83907]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-749db045-720c-4875-bc46-b41e5536ca03 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-749db045-720c-4875-bc46-b41e5536ca03 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2" returned: 0 in 1.783s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:40 devstack sudo[83926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2 Apr 15 10:06:40 devstack sudo[83926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:40 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bb71f1-c701-40e2-8486-04d1dc8ac820]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-749db045-720c-4875-bc46-b41e5536ca03 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:40 devstack sudo[83928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 Apr 15 10:06:40 devstack sudo[83928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:41 devstack sudo[83926]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2" returned: 0 in 1.092s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:41 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Lock "cinder-quobyte-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2" released by "delete_volume" :: held 3.014s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:41 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Created reservations ['5882c85e-f5e9-4960-be18-2c587e7062dc', '70b23f0e-905a-4e04-9cbb-27e2ef4dfaad', '1d203107-a518-4cbb-b30c-8617df8af60e', 'c47dd073-05da-4959-9cf7-a2810b2b8128'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:42 devstack sudo[83936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:06:42 devstack sudo[83936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:42 devstack sudo[83928]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-749db045-720c-4875-bc46-b41e5536ca03 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841" returned: 0 in 1.575s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-749db045-720c-4875-bc46-b41e5536ca03 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.655s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "cinder-28e2229b-cd74-4107-8804-5544844064ea-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Lock "cinder-28e2229b-cd74-4107-8804-5544844064ea-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-749db045-720c-4875-bc46-b41e5536ca03 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c', 'name': 'volume-cff5df33-2017-4106-ba94-d1a2c81a5841', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '558238df-8bde-470e-8d3d-096fe48b4217', 'enforce_multipath': True} {{(pid=82600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 10:06:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "cinder-quobyte-28e2229b-cd74-4107-8804-5544844064ea" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:06:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Lock "cinder-quobyte-28e2229b-cd74-4107-8804-5544844064ea" acquired by "delete_volume" :: waited 0.148s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:06:42 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2a9861-083b-4a16-9d4d-351d59ce3916]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:06:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:43 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-e76199cc-cc31-4e49-ba4f-169ffbe49bfb req-749db045-720c-4875-bc46-b41e5536ca03 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] attachment_update completed successfully. Apr 15 10:06:43 devstack sudo[83938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea Apr 15 10:06:43 devstack sudo[83938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:43 devstack sudo[83936]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.812s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:43 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:43 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Deleted volume successfully. Apr 15 10:06:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0f4ae394-a63b-45cf-938d-f0777f03ed6b tempest-ServersNegativeTestJSON-1662516059 None] Lock "cinder-cdbd48f2-9bbd-4b12-95b8-fb85b25798c2-delete_volume" released by "delete_volume" :: held 5.326s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:44 devstack sudo[83938]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea" returned: 0 in 1.291s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:44 devstack sudo[83945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea Apr 15 10:06:44 devstack sudo[83945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:45 devstack sudo[83945]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28e2229b-cd74-4107-8804-5544844064ea" returned: 0 in 1.136s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Lock "cinder-quobyte-28e2229b-cd74-4107-8804-5544844064ea" released by "delete_volume" :: held 2.552s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:45 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Created reservations ['e2da2608-c09e-4d66-a8ae-dc5210e3b1e4', '1e6c7348-e0da-4aec-a6f3-3cd57e96bb98', '3a64f567-0b61-4f28-acfd-ef52e330166e', '89d1a2a6-3e29-4750-84f9-e3b4fff80982'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:06:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:45 devstack sudo[83952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:06:45 devstack sudo[83952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:47 devstack sudo[83952]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.476s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:47 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:06:47 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Deleted volume successfully. Apr 15 10:06:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-69fd43b8-4e8d-402c-ac51-4a5974592b9d tempest-ServersNegativeTestJSON-1662516059 None] Lock "cinder-28e2229b-cd74-4107-8804-5544844064ea-delete_volume" released by "delete_volume" :: held 4.682s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Flow 'volume_create_manager' (9bbf47c9-5670-4bda-aaca-4afecae9a0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33de9cf9-5541-4205-9a98-1354e9d209ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33de9cf9-5541-4205-9a98-1354e9d209ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-474705447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994c0006-f24f-4f13-bcb4-b5e21295dab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21017e6436cc442888120d091deff59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:55Z,use_quota=True,user_id='28e44aff3ff74531b33b6a54febedfb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49923030-950a-48ab-b32c-cb53ddbf33c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49923030-950a-48ab-b32c-cb53ddbf33c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61aef543-c81e-4a29-958e-718738e0ec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61aef543-c81e-4a29-958e-718738e0ec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '994c0006-f24f-4f13-bcb4-b5e21295dab7', 'volume_name': 'volume-994c0006-f24f-4f13-bcb4-b5e21295dab7', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ff6956-a978-4d02-a45b-6c2f63af90c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ff6956-a978-4d02-a45b-6c2f63af90c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85367ac-5b66-43a1-98f2-d43aff03e20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:55 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Volume 994c0006-f24f-4f13-bcb4-b5e21295dab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-994c0006-f24f-4f13-bcb4-b5e21295dab7', 'volume_size': 1} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:06:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-474705447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994c0006-f24f-4f13-bcb4-b5e21295dab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21017e6436cc442888120d091deff59f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:06:55Z,use_quota=True,user_id='28e44aff3ff74531b33b6a54febedfb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Creating volume 994c0006-f24f-4f13-bcb4-b5e21295dab7 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:06:55 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:06:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:55 devstack sudo[84488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 1073741824 Apr 15 10:06:55 devstack sudo[84488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:56 devstack sudo[84488]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 1073741824" returned: 0 in 1.421s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:06:56 devstack sudo[84494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 Apr 15 10:06:56 devstack sudo[84494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:06:57 devstack sudo[84494]: pam_unix(sudo:session): session closed for user root Apr 15 10:06:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7" returned: 0 in 0.754s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:06:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:06:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.260s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:06:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d85367ac-5b66-43a1-98f2-d43aff03e20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994c0006-f24f-4f13-bcb4-b5e21295dab7', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bc4855-b708-48eb-a54e-abec3f79a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:06:57 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Volume volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 (994c0006-f24f-4f13-bcb4-b5e21295dab7): created successfully Apr 15 10:06:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46bc4855-b708-48eb-a54e-abec3f79a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:06:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Flow 'volume_create_manager' (9bbf47c9-5670-4bda-aaca-4afecae9a0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:06:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-41e89f4f-966c-4fbd-b0e1-8ba1c485b928 tempest-ServerRescueNegativeTestJSON-1452302564 None] Created volume successfully. Apr 15 10:07:05 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Flow 'volume_create_manager' (564d45cf-04e8-45a9-9468-52ca532e4219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d73c82-7215-4cee-8ab8-9d47202d3103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d73c82-7215-4cee-8ab8-9d47202d3103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-248539259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6ca960-3024-41f7-a681-3cf2402fab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7115f0715ac245fc978c1aab23b7e189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:06Z,use_quota=True,user_id='1aac683238734b9485b30093b162ecbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e52117-7b79-43f1-bf2e-ededa5ebcee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92e52117-7b79-43f1-bf2e-ededa5ebcee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f93db0-aa22-4b25-ac3a-8b301a41e947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8f93db0-aa22-4b25-ac3a-8b301a41e947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd6ca960-3024-41f7-a681-3cf2402fab20', 'volume_name': 'volume-dd6ca960-3024-41f7-a681-3cf2402fab20', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00c811d-7d0e-4668-8e64-c35dd19acee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f00c811d-7d0e-4668-8e64-c35dd19acee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f4ac62-8a2c-4ef8-8dc1-da19eed953f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:06 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Volume dd6ca960-3024-41f7-a681-3cf2402fab20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd6ca960-3024-41f7-a681-3cf2402fab20', 'volume_size': 1} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-248539259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd6ca960-3024-41f7-a681-3cf2402fab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7115f0715ac245fc978c1aab23b7e189',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:06Z,use_quota=True,user_id='1aac683238734b9485b30093b162ecbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Creating volume dd6ca960-3024-41f7-a681-3cf2402fab20 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:06 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:06 devstack sudo[84671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 1073741824 Apr 15 10:07:06 devstack sudo[84671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:06 devstack sudo[84671]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 1073741824" returned: 0 in 0.694s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:06 devstack sudo[84677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 Apr 15 10:07:06 devstack sudo[84677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:07 devstack sudo[84677]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20" returned: 0 in 0.670s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.415s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f4ac62-8a2c-4ef8-8dc1-da19eed953f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd6ca960-3024-41f7-a681-3cf2402fab20', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228aff7a-8143-4da0-931a-354de74cec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:07 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Volume volume-dd6ca960-3024-41f7-a681-3cf2402fab20 (dd6ca960-3024-41f7-a681-3cf2402fab20): created successfully Apr 15 10:07:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (228aff7a-8143-4da0-931a-354de74cec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Flow 'volume_create_manager' (564d45cf-04e8-45a9-9468-52ca532e4219) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:07 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-5d7c1282-51c9-4cc1-9e00-be2b97a50b7c req-77a7f439-e8de-4f76-a8e5-9c38e5edcde2 tempest-VolumesSnapshotsTestJSON-825317529 None] Created volume successfully. Apr 15 10:07:08 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=34,cinder:UPDATE=49,cinder:INSERT=11,cinder:DELETE=5 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:07:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Creating offline snapshot 5999611a-501d-4322-b280-0e62be5e39f4 of volume dd6ca960-3024-41f7-a681-3cf2402fab20 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:07:08 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde8bab0-e68c-4638-8537-52092533272e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:09 devstack sudo[84743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 Apr 15 10:07:09 devstack sudo[84743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:07:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:10 devstack sudo[84752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:07:10 devstack sudo[84752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:10 devstack sudo[84743]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20" returned: 0 in 1.609s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:10 devstack sudo[84754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 1G Apr 15 10:07:10 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:12 devstack sudo[84752]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.778s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:12 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:12 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 1G" returned: 0 in 2.005s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6ca960-3024-41f7-a681-3cf2402fab20 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:12 devstack sudo[84764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6ca960-3024-41f7-a681-3cf2402fab20 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 Apr 15 10:07:12 devstack sudo[84764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:13 devstack sudo[84764]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd6ca960-3024-41f7-a681-3cf2402fab20 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4" returned: 0 in 1.076s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:13 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 is being set with open permissions: ugo+rw Apr 15 10:07:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:13 devstack sudo[84769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 Apr 15 10:07:13 devstack sudo[84769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:14 devstack sudo[84769]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4" returned: 0 in 0.957s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:14 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:UPDATE=39,cinder:SELECT=34,cinder:DELETE=4,cinder:INSERT=7 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:07:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:14 devstack sudo[84772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.info Apr 15 10:07:14 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:15 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.info" returned: 0 in 1.238s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:15 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.info is being set with open permissions: ugo+rw Apr 15 10:07:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:16 devstack sudo[84838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.info Apr 15 10:07:16 devstack sudo[84838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:17 devstack sudo[84838]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.info" returned: 0 in 1.375s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.488s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:17 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-bd1bd8ee-3be6-474d-b34e-e0fb7f4d2e5d req-4a3890c4-633e-41cb-9a47-449c849e3156 tempest-VolumesSnapshotsTestJSON-825317529 None] Create snapshot completed successfully Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Acquiring lock "cinder-5999611a-501d-4322-b280-0e62be5e39f4-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-5999611a-501d-4322-b280-0e62be5e39f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Acquiring lock "cinder-quobyte-dd6ca960-3024-41f7-a681-3cf2402fab20" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-quobyte-dd6ca960-3024-41f7-a681-3cf2402fab20" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Acquiring lock "cinder-quobyte-5999611a-501d-4322-b280-0e62be5e39f4" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-quobyte-5999611a-501d-4322-b280-0e62be5e39f4" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Deleting offline snapshot 5999611a-501d-4322-b280-0e62be5e39f4 of volume dd6ca960-3024-41f7-a681-3cf2402fab20 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] snapshot_file for this snap is: volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[26af1dcc-95a8-4e38-bf52-1bba2facc357]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:19 devstack sudo[84889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 Apr 15 10:07:19 devstack sudo[84889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Acquiring lock "cinder-994c0006-f24f-4f13-bcb4-b5e21295dab7-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "cinder-994c0006-f24f-4f13-bcb4-b5e21295dab7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Acquiring lock "cinder-quobyte-994c0006-f24f-4f13-bcb4-b5e21295dab7" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "cinder-quobyte-994c0006-f24f-4f13-bcb4-b5e21295dab7" acquired by "delete_volume" :: waited 0.022s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:19 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[cece1d3d-e5f6-4278-9cd7-7ac105f10ec2]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:19 devstack sudo[84894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 Apr 15 10:07:19 devstack sudo[84894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:20 devstack sudo[84889]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4" returned: 0 in 1.628s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd6ca960-3024-41f7-a681-3cf2402fab20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:07:20 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4739915c-e82b-43b5-bb00-d937eccab953]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:20 devstack sudo[84902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 Apr 15 10:07:20 devstack sudo[84902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:21 devstack sudo[84894]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7" returned: 0 in 1.520s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:21 devstack sudo[84912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7 Apr 15 10:07:21 devstack sudo[84912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:22 devstack sudo[84902]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20" returned: 0 in 1.647s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:22 devstack sudo[84922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 Apr 15 10:07:22 devstack sudo[84922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:22 devstack sudo[84912]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-994c0006-f24f-4f13-bcb4-b5e21295dab7" returned: 0 in 1.360s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "cinder-quobyte-994c0006-f24f-4f13-bcb4-b5e21295dab7" released by "delete_volume" :: held 3.017s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:22 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Created reservations ['9cea57e4-2670-4a5d-b359-e24301c8ac36', 'ab3c16de-5fe6-4847-b288-86ea3a48a3b8', 'c86674a4-7f52-482b-8171-ccf763486655', '7e78a1c4-971e-435e-b720-ae1a4e3de62d'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:23 devstack sudo[84936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:07:23 devstack sudo[84936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:23 devstack sudo[84922]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4" returned: 0 in 1.237s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:23 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4 Apr 15 10:07:23 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:23 devstack sudo[84936]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.689s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:23 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Deleted volume successfully. Apr 15 10:07:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1aa6e5f4-268f-4dc3-bb36-78baa0a1bb0a tempest-ServerRescueNegativeTestJSON-1452302564 None] Lock "cinder-994c0006-f24f-4f13-bcb4-b5e21295dab7-delete_volume" released by "delete_volume" :: held 4.385s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:24 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20.5999611a-501d-4322-b280-0e62be5e39f4" returned: 0 in 0.581s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-quobyte-5999611a-501d-4322-b280-0e62be5e39f4" released by "_delete_snapshot" :: held 5.336s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-quobyte-dd6ca960-3024-41f7-a681-3cf2402fab20" released by "delete_snapshot" :: held 5.397s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:24 devstack cinder-volume[82600]: WARNING cinder.quota [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG cinder.quota [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Created reservations ['f14df8a6-bdd6-4c60-af46-1f6d79515802', '877802b1-dc4e-481f-9f78-b3e2c505a969', 'f5bf0379-210e-483c-90cd-79bbb4770b80', '4be567a3-8b45-444e-b37e-77c3df638b06'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:07:24 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Delete snapshot completed successfully. Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-e7e498ae-47e2-4454-b9ff-7442b0aa9dcc req-498e36a4-51e0-4d48-b4d0-a0deeb96877f tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-5999611a-501d-4322-b280-0e62be5e39f4-delete_snapshot" released by "delete_snapshot" :: held 5.622s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Acquiring lock "cinder-dd6ca960-3024-41f7-a681-3cf2402fab20-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-dd6ca960-3024-41f7-a681-3cf2402fab20-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Acquiring lock "cinder-quobyte-dd6ca960-3024-41f7-a681-3cf2402fab20" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-quobyte-dd6ca960-3024-41f7-a681-3cf2402fab20" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cc2550-f1aa-4819-95d0-168424821cbf]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:24 devstack sudo[84952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 Apr 15 10:07:24 devstack sudo[84952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:25 devstack sudo[84952]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20" returned: 0 in 0.957s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:25 devstack sudo[84989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20 Apr 15 10:07:25 devstack sudo[84989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:26 devstack sudo[84989]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-dd6ca960-3024-41f7-a681-3cf2402fab20" returned: 0 in 0.597s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-quobyte-dd6ca960-3024-41f7-a681-3cf2402fab20" released by "delete_volume" :: held 1.612s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:26 devstack cinder-volume[82600]: DEBUG cinder.quota [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Created reservations ['0ea51a76-16e4-4245-aab3-d2303f0dfeb5', '9f192a35-37bb-42f5-9dbb-c21bb392af64', 'c001eea5-5889-445e-9497-0254c728d1e3', '411043ab-6a53-46c8-b6bf-04cc4af5234a'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:07:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:26 devstack sudo[84992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:07:26 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:27 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.785s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:27 devstack cinder-volume[82600]: DEBUG cinder.manager [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:27 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Deleted volume successfully. Apr 15 10:07:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-74d18cd5-8b7e-4015-a31f-66d5553bdf3b req-3feb4c4b-1322-46ed-8c39-2d1b0adb84e6 tempest-VolumesSnapshotsTestJSON-825317529 None] Lock "cinder-dd6ca960-3024-41f7-a681-3cf2402fab20-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:31 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Flow 'volume_create_manager' (41081b1c-6e43-47e9-bce4-733dbeddac53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad229dab-83f7-4743-98bc-f321420d0776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad229dab-83f7-4743-98bc-f321420d0776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-78781203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6d53e2-9174-47c3-b503-061317990ee1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab381d595e3943f8be90e5812174489b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:32Z,use_quota=True,user_id='48c3ab9b4bf84ff5ae840ea49461f244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e69ba98-489b-4db6-a172-ba7b4babc99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e69ba98-489b-4db6-a172-ba7b4babc99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69f3981-ffcd-464e-8cc6-08394944851d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f69f3981-ffcd-464e-8cc6-08394944851d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f6d53e2-9174-47c3-b503-061317990ee1', 'volume_name': 'volume-3f6d53e2-9174-47c3-b503-061317990ee1', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460fd034-0391-41fc-8b6e-70b62e83623c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460fd034-0391-41fc-8b6e-70b62e83623c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129dd7c0-5612-4855-bb4b-03f36284ec5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:32 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Volume 3f6d53e2-9174-47c3-b503-061317990ee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f6d53e2-9174-47c3-b503-061317990ee1', 'volume_size': 1} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-78781203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6d53e2-9174-47c3-b503-061317990ee1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab381d595e3943f8be90e5812174489b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:32Z,use_quota=True,user_id='48c3ab9b4bf84ff5ae840ea49461f244',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Creating volume 3f6d53e2-9174-47c3-b503-061317990ee1 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:32 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:07:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:32 devstack sudo[85032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1 1073741824 Apr 15 10:07:32 devstack sudo[85032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:32 devstack sudo[85032]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1 1073741824" returned: 0 in 0.953s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:33 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1 Apr 15 10:07:33 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:33 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1" returned: 0 in 0.907s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129dd7c0-5612-4855-bb4b-03f36284ec5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6d53e2-9174-47c3-b503-061317990ee1', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fd63cf-70e0-4852-8e7e-bfaef820800e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:33 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Volume volume-3f6d53e2-9174-47c3-b503-061317990ee1 (3f6d53e2-9174-47c3-b503-061317990ee1): created successfully Apr 15 10:07:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fd63cf-70e0-4852-8e7e-bfaef820800e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Flow 'volume_create_manager' (41081b1c-6e43-47e9-bce4-733dbeddac53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:33 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-2ea80a24-fc32-4205-8482-1a7c13ad3a04 req-32759d6c-d557-4fe5-b1cf-6afd8ec4539d tempest-VolumesGetTestJSON-1688432861 None] Created volume successfully. Apr 15 10:07:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Acquiring lock "cinder-3f6d53e2-9174-47c3-b503-061317990ee1-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Lock "cinder-3f6d53e2-9174-47c3-b503-061317990ee1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Acquiring lock "cinder-quobyte-3f6d53e2-9174-47c3-b503-061317990ee1" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Lock "cinder-quobyte-3f6d53e2-9174-47c3-b503-061317990ee1" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:34 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4086aa-166a-42a1-b14f-515c15d43e2f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:34 devstack sudo[85116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1 Apr 15 10:07:34 devstack sudo[85116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:35 devstack sudo[85116]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1" returned: 0 in 0.696s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:35 devstack sudo[85122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1 Apr 15 10:07:35 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:36 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3f6d53e2-9174-47c3-b503-061317990ee1" returned: 0 in 0.497s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Lock "cinder-quobyte-3f6d53e2-9174-47c3-b503-061317990ee1" released by "delete_volume" :: held 1.241s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG cinder.quota [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Created reservations ['7b2adbd3-72db-424c-888a-300c5da6da2b', '3de87f91-f60a-4bda-863a-cdd6b6526e01', '03aa392a-cba0-4f5c-9afc-4f8c93d08da6', '6529e285-d188-4152-8f37-41ea1b5c7ddf'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:36 devstack sudo[85128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:07:36 devstack sudo[85128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:36 devstack sudo[85128]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.496s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG cinder.manager [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:36 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Deleted volume successfully. Apr 15 10:07:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-62141f7e-e545-449b-a42c-710b3444dfea req-e0686775-ae89-4054-a5f8-4bd3e2dc5284 tempest-VolumesGetTestJSON-1688432861 None] Lock "cinder-3f6d53e2-9174-47c3-b503-061317990ee1-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Flow 'volume_create_manager' (f1989b50-5ae5-4177-b51e-255941c39346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39ed98e-e7c0-4c81-a3e7-71c8e0a71b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a39ed98e-e7c0-4c81-a3e7-71c8e0a71b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2114894771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f04df92-4974-4742-a850-e57f1e06008f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9a74c1e12aa4a1486b57ee7460d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:41Z,use_quota=True,user_id='994ad818326a4e0aac56e1efe38c424b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a993dd-e4cd-499d-8e21-5fcaf0cbe9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2a993dd-e4cd-499d-8e21-5fcaf0cbe9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef745d8-729f-4e3d-86a2-df15631bc0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ef745d8-729f-4e3d-86a2-df15631bc0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f04df92-4974-4742-a850-e57f1e06008f', 'volume_name': 'volume-6f04df92-4974-4742-a850-e57f1e06008f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06f2c55-4e79-457c-9b92-c6284a9f40fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06f2c55-4e79-457c-9b92-c6284a9f40fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adedbca6-4b10-460e-8f30-f915dce4ec7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:41 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Volume 6f04df92-4974-4742-a850-e57f1e06008f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f04df92-4974-4742-a850-e57f1e06008f', 'volume_size': 1} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2114894771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f04df92-4974-4742-a850-e57f1e06008f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9a74c1e12aa4a1486b57ee7460d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:41Z,use_quota=True,user_id='994ad818326a4e0aac56e1efe38c424b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Creating volume 6f04df92-4974-4742-a850-e57f1e06008f {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:41 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:41 devstack sudo[85203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f 1073741824 Apr 15 10:07:41 devstack sudo[85203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Flow 'volume_create_manager' (8cd2b80f-69d2-4db4-8a9c-f48922633061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6964a5db-c479-4438-8566-fc5608d3e51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6964a5db-c479-4438-8566-fc5608d3e51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2005925756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2482396-cf44-4b63-b813-147ab2b1a270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d728f1371a2454ea61053e50fd0a2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:42Z,use_quota=True,user_id='c43379ed7c62407c94e094f7c423f8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e70f94e-578b-4198-be06-14e07baf54f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e70f94e-578b-4198-be06-14e07baf54f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d4bb33-1e8b-4313-9000-d47fda245b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7d4bb33-1e8b-4313-9000-d47fda245b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2482396-cf44-4b63-b813-147ab2b1a270', 'volume_name': 'volume-e2482396-cf44-4b63-b813-147ab2b1a270', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525bafa2-9657-4f72-bd4a-c14a1fbc5c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (525bafa2-9657-4f72-bd4a-c14a1fbc5c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de2951c-d700-4e98-8098-728380e4506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:42 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Volume e2482396-cf44-4b63-b813-147ab2b1a270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2482396-cf44-4b63-b813-147ab2b1a270', 'volume_size': 1} Apr 15 10:07:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:43 devstack sudo[85203]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f 1073741824" returned: 0 in 1.392s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:43 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f Apr 15 10:07:43 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:43 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f" returned: 0 in 0.749s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] <== create_volume: return (2219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.703s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2005925756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2482396-cf44-4b63-b813-147ab2b1a270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d728f1371a2454ea61053e50fd0a2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:42Z,use_quota=True,user_id='c43379ed7c62407c94e094f7c423f8c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Creating volume e2482396-cf44-4b63-b813-147ab2b1a270 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:43 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adedbca6-4b10-460e-8f30-f915dce4ec7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f04df92-4974-4742-a850-e57f1e06008f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d4a05-3f5d-42be-9659-69145effefa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:43 devstack sudo[85216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 1073741824 Apr 15 10:07:43 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Volume volume-6f04df92-4974-4742-a850-e57f1e06008f (6f04df92-4974-4742-a850-e57f1e06008f): created successfully Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0d4a05-3f5d-42be-9659-69145effefa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:43 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Flow 'volume_create_manager' (f1989b50-5ae5-4177-b51e-255941c39346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:43 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7e47c632-d1e9-496e-8785-21af7f5aa570 tempest-VolumesTestJSON-1683723084 None] Created volume successfully. Apr 15 10:07:44 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 1073741824" returned: 0 in 0.790s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:44 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 Apr 15 10:07:44 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Flow 'volume_create_manager' (b7dfc9f9-f14f-48f4-9df1-963098c3d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a153a52-689e-4974-9031-8da2f7fc742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a153a52-689e-4974-9031-8da2f7fc742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-859728944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbed85f-41a7-4c27-8a83-f2ee110daffe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9a74c1e12aa4a1486b57ee7460d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:45Z,use_quota=True,user_id='994ad818326a4e0aac56e1efe38c424b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4fa8ff-3ffb-4534-85d5-b142e15fb39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4fa8ff-3ffb-4534-85d5-b142e15fb39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e2f29d-5d18-4909-850a-d04cea614b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1e2f29d-5d18-4909-850a-d04cea614b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfbed85f-41a7-4c27-8a83-f2ee110daffe', 'volume_name': 'volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe4dde7-bf88-410c-a228-da854026632b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe4dde7-bf88-410c-a228-da854026632b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ace324a-0f4c-40a3-90d3-fb38beca695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:45 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Volume cfbed85f-41a7-4c27-8a83-f2ee110daffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe', 'volume_size': 1} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:45 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270" returned: 0 in 1.036s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] <== create_volume: return (1864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.102s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-859728944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbed85f-41a7-4c27-8a83-f2ee110daffe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9a74c1e12aa4a1486b57ee7460d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:45Z,use_quota=True,user_id='994ad818326a4e0aac56e1efe38c424b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Creating volume cfbed85f-41a7-4c27-8a83-f2ee110daffe {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:45 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de2951c-d700-4e98-8098-728380e4506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2482396-cf44-4b63-b813-147ab2b1a270', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f004c944-ff7c-400a-a2bd-6f4f9892a9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:45 devstack sudo[85224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe 1073741824 Apr 15 10:07:45 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:45 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Volume volume-e2482396-cf44-4b63-b813-147ab2b1a270 (e2482396-cf44-4b63-b813-147ab2b1a270): created successfully Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f004c944-ff7c-400a-a2bd-6f4f9892a9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Flow 'volume_create_manager' (8cd2b80f-69d2-4db4-8a9c-f48922633061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d6fae0a1-9d7c-4123-aed3-3b436096eaa4 tempest-DeleteServersTestJSON-456247990 None] Created volume successfully. Apr 15 10:07:46 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe 1073741824" returned: 0 in 0.999s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:46 devstack sudo[85229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe Apr 15 10:07:46 devstack sudo[85229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:47 devstack sudo[85229]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe" returned: 0 in 0.683s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:47 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ace324a-0f4c-40a3-90d3-fb38beca695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:47 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587f5960-3c10-46c9-ac26-4e89b1520b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:47 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Volume volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe (cfbed85f-41a7-4c27-8a83-f2ee110daffe): created successfully Apr 15 10:07:47 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587f5960-3c10-46c9-ac26-4e89b1520b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:47 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Flow 'volume_create_manager' (b7dfc9f9-f14f-48f4-9df1-963098c3d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:47 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-fa64dd17-f243-445c-b420-91d22afdd823 tempest-VolumesTestJSON-1683723084 None] Created volume successfully. Apr 15 10:07:48 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Flow 'volume_create_manager' (198f8465-b155-4ff2-80db-de4e622ba69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9dba83-2b7b-4ee0-bde0-b1c4a781e01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cdb221c2-ad9f-46d2-b922-b312fdd334c0 tempest-BackendsCapabilitiesAdminTestsJSON-556329499 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710105895996, 'free_capacity_gb': 1775.710105895996, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82600) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f9dba83-2b7b-4ee0-bde0-b1c4a781e01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-84149378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ec5112-57f7-4321-bfb1-5f2251700e10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9a74c1e12aa4a1486b57ee7460d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:49Z,use_quota=True,user_id='994ad818326a4e0aac56e1efe38c424b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7f92c4-6019-4a11-83d7-2ea7c085383b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7f92c4-6019-4a11-83d7-2ea7c085383b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e19afb-e773-4ec1-94cf-23b2cf0a8660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e19afb-e773-4ec1-94cf-23b2cf0a8660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ec5112-57f7-4321-bfb1-5f2251700e10', 'volume_name': 'volume-98ec5112-57f7-4321-bfb1-5f2251700e10', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78a19a3-7553-45cf-83aa-8a102ee71434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78a19a3-7553-45cf-83aa-8a102ee71434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a3111e-4fc7-454b-bbb5-8ea5f1c5bf20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:49 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Volume 98ec5112-57f7-4321-bfb1-5f2251700e10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ec5112-57f7-4321-bfb1-5f2251700e10', 'volume_size': 1} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-84149378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ec5112-57f7-4321-bfb1-5f2251700e10,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d9a74c1e12aa4a1486b57ee7460d7b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:49Z,use_quota=True,user_id='994ad818326a4e0aac56e1efe38c424b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Creating volume 98ec5112-57f7-4321-bfb1-5f2251700e10 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:07:49 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:49 devstack sudo[85244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10 1073741824 Apr 15 10:07:49 devstack sudo[85244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a16c6622-7888-48f9-865e-785c955a86ad tempest-BackendsCapabilitiesAdminTestsJSON-556329499 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.710105895996, 'free_capacity_gb': 1775.710105895996, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82600) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 15 10:07:49 devstack sudo[85244]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10 1073741824" returned: 0 in 0.715s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:49 devstack sudo[85250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10 Apr 15 10:07:49 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-203a1814-9c56-4b06-8616-b0d421e5d952 req-6c537004-cb68-4452-b05e-ccf9e722f9d9 tempest-DeleteServersTestJSON-456247990 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:50 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10" returned: 0 in 0.593s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] <== create_volume: return (1369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.371s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-203a1814-9c56-4b06-8616-b0d421e5d952 req-6c537004-cb68-4452-b05e-ccf9e722f9d9 tempest-DeleteServersTestJSON-456247990 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.171s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a3111e-4fc7-454b-bbb5-8ea5f1c5bf20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ec5112-57f7-4321-bfb1-5f2251700e10', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f6d84d-f86e-42cc-a1dd-2c8ddfab8414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e795999e-a2d6-45e5-90f3-4ce7e4c26af9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-203a1814-9c56-4b06-8616-b0d421e5d952 req-6c537004-cb68-4452-b05e-ccf9e722f9d9 tempest-DeleteServersTestJSON-456247990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:50 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Volume volume-98ec5112-57f7-4321-bfb1-5f2251700e10 (98ec5112-57f7-4321-bfb1-5f2251700e10): created successfully Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f6d84d-f86e-42cc-a1dd-2c8ddfab8414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Flow 'volume_create_manager' (198f8465-b155-4ff2-80db-de4e622ba69f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:50 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d56ca0d6-e425-407a-a796-53df052e6b6b tempest-VolumesTestJSON-1683723084 None] Created volume successfully. Apr 15 10:07:50 devstack sudo[85261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 Apr 15 10:07:50 devstack sudo[85261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:51 devstack sudo[85261]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-203a1814-9c56-4b06-8616-b0d421e5d952 req-6c537004-cb68-4452-b05e-ccf9e722f9d9 tempest-DeleteServersTestJSON-456247990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270" returned: 0 in 1.083s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-203a1814-9c56-4b06-8616-b0d421e5d952 req-6c537004-cb68-4452-b05e-ccf9e722f9d9 tempest-DeleteServersTestJSON-456247990 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.104s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-203a1814-9c56-4b06-8616-b0d421e5d952 req-6c537004-cb68-4452-b05e-ccf9e722f9d9 tempest-DeleteServersTestJSON-456247990 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c', 'name': 'volume-e2482396-cf44-4b63-b813-147ab2b1a270', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fab238f-20d8-4ee8-9420-98c05885b626', 'enforce_multipath': True} {{(pid=82600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 10:07:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-203a1814-9c56-4b06-8616-b0d421e5d952 req-6c537004-cb68-4452-b05e-ccf9e722f9d9 tempest-DeleteServersTestJSON-456247990 None] attachment_update completed successfully. Apr 15 10:07:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Acquiring lock "cinder-98ec5112-57f7-4321-bfb1-5f2251700e10-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Lock "cinder-98ec5112-57f7-4321-bfb1-5f2251700e10-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Acquiring lock "cinder-quobyte-98ec5112-57f7-4321-bfb1-5f2251700e10" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Lock "cinder-quobyte-98ec5112-57f7-4321-bfb1-5f2251700e10" acquired by "delete_volume" :: waited 0.020s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:52 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad33149-3dda-44e6-af13-65f9b6c7d2fb]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:52 devstack sudo[85277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10 Apr 15 10:07:52 devstack sudo[85277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:53 devstack sudo[85277]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10" returned: 0 in 0.872s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:53 devstack sudo[85282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10 Apr 15 10:07:53 devstack sudo[85282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:54 devstack sudo[85282]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-98ec5112-57f7-4321-bfb1-5f2251700e10" returned: 0 in 1.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Lock "cinder-quobyte-98ec5112-57f7-4321-bfb1-5f2251700e10" released by "delete_volume" :: held 2.524s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Created reservations ['c02a32fd-54b5-49ca-b30b-5067804e3fae', 'd80a7df5-d5f1-4b7e-9d03-5a9c96e91098', '1704f354-ea60-47c5-bcd9-7ed28cb0adfe', '1646a19d-0507-465a-bff4-830fdffb22f3'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:55 devstack sudo[85288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:07:55 devstack sudo[85288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Flow 'volume_create_manager' (46c77190-caad-42b7-b73d-6c6253bc5868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a16f15-90a4-42a7-9b9e-bbeb34166026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a16f15-90a4-42a7-9b9e-bbeb34166026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:55Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b605d9-1620-469e-8cff-b3c2d2730904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2520ad0ad1ee4678a4b520b6d1723f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:55Z,use_quota=True,user_id='baf60878e7b24875ae2c67810b2ad186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaabada-e49d-4fd8-a3a4-8710ea633ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcaabada-e49d-4fd8-a3a4-8710ea633ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755a4dcd-88cb-4d7d-bcc2-33ffe069a953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.image.glance [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Creating Keystone auth plugin from conf {{(pid=82600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "cinder-cfbed85f-41a7-4c27-8a83-f2ee110daffe-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Lock "cinder-cfbed85f-41a7-4c27-8a83-f2ee110daffe-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "cinder-quobyte-cfbed85f-41a7-4c27-8a83-f2ee110daffe" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:07:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Lock "cinder-quobyte-cfbed85f-41a7-4c27-8a83-f2ee110daffe" acquired by "delete_volume" :: waited 0.045s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:07:56 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5749e3-5b6f-426a-bac5-edeee8ead502]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:56 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe Apr 15 10:07:56 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:57 devstack sudo[85288]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 2.144s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:57 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:07:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Deleted volume successfully. Apr 15 10:07:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aedcb37b-13bd-4f7d-83b7-8f4ee087349c tempest-VolumesTestJSON-1683723084 None] Lock "cinder-98ec5112-57f7-4321-bfb1-5f2251700e10-delete_volume" released by "delete_volume" :: held 5.116s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (755a4dcd-88cb-4d7d-bcc2-33ffe069a953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32b605d9-1620-469e-8cff-b3c2d2730904', 'volume_name': 'volume-32b605d9-1620-469e-8cff-b3c2d2730904', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de0fd05-840c-43b8-b27a-7b2911b324d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0de0fd05-840c-43b8-b27a-7b2911b324d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:07:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0080b2c2-f7e3-4ec8-9b0d-af347afcbb5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:07:57 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Volume 32b605d9-1620-469e-8cff-b3c2d2730904: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32b605d9-1620-469e-8cff-b3c2d2730904', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:07:57 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Trying to clone 32b605d9-1620-469e-8cff-b3c2d2730904 from image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]). {{(pid=82600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:07:58 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe" returned: 0 in 1.842s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:58 devstack sudo[85326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe Apr 15 10:07:58 devstack sudo[85326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:58 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:07:58 devstack cinder-volume[82600]: INFO cinder.image.image_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:07:58 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ec0e84-599d-489c-9a61-09cd55e5b65a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:58 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD Apr 15 10:07:58 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:59 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD" returned: 0 in 0.907s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Temporary image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 is fetched for user baf60878e7b24875ae2c67810b2ad186. {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f2dc6-f2dd-4279-9da0-4d63e8ef1db9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:59 devstack sudo[85326]: pam_unix(sudo:session): session closed for user root Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cfbed85f-41a7-4c27-8a83-f2ee110daffe" returned: 0 in 1.306s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Lock "cinder-quobyte-cfbed85f-41a7-4c27-8a83-f2ee110daffe" released by "delete_volume" :: held 3.286s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Created reservations ['88855621-7d3c-4b24-9bd0-77a394f2a598', '81316b76-5bf7-4891-9557-4fb9f9b4106a', '7ba193ec-1cc1-4b9d-8b5d-a5572a3f3a3b', '6685a2f7-39f2-4d9b-8b47-c3e80befacbd'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:07:59 devstack sudo[85394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD Apr 15 10:07:59 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:07:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:07:59 devstack sudo[85396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:07:59 devstack sudo[85396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:00 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD" returned: 0 in 0.684s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:07:55Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32b605d9-1620-469e-8cff-b3c2d2730904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2520ad0ad1ee4678a4b520b6d1723f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:07:55Z,use_quota=True,user_id='baf60878e7b24875ae2c67810b2ad186',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Creating volume 32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:00 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:00 devstack sudo[85418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 1073741824 Apr 15 10:08:00 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "cinder-6f04df92-4974-4742-a850-e57f1e06008f-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Lock "cinder-6f04df92-4974-4742-a850-e57f1e06008f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "cinder-quobyte-6f04df92-4974-4742-a850-e57f1e06008f" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:00 devstack sudo[85396]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Lock "cinder-quobyte-6f04df92-4974-4742-a850-e57f1e06008f" acquired by "delete_volume" :: waited 0.032s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.167s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50fc459-258b-412a-8413-0511c76f231a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Deleted volume successfully. Apr 15 10:08:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-526c27cc-a208-4451-b7b0-20a5a89b0347 tempest-VolumesTestJSON-1683723084 None] Lock "cinder-cfbed85f-41a7-4c27-8a83-f2ee110daffe-delete_volume" released by "delete_volume" :: held 4.753s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:00 devstack sudo[85422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f Apr 15 10:08:00 devstack sudo[85422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:01 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 1073741824" returned: 0 in 0.966s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:01 devstack sudo[85427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 Apr 15 10:08:01 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:01 devstack sudo[85422]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f" returned: 0 in 0.693s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:01 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f Apr 15 10:08:01 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:01 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-29847e6d-1880-4962-a5ed-4e08a4d58f5a req-c4a43e3b-916f-4f31-8f5f-fb9040114542 tempest-DeleteServersTestJSON-456247990 None] Terminate volume connection completed successfully. Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-29847e6d-1880-4962-a5ed-4e08a4d58f5a req-c4a43e3b-916f-4f31-8f5f-fb9040114542 tempest-DeleteServersTestJSON-456247990 None] Deleting attachment 0fab238f-20d8-4ee8-9420-98c05885b626. {{(pid=82600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 10:08:01 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904" returned: 0 in 0.648s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Attempting download of 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}])) to volume 32b605d9-1620-469e-8cff-b3c2d2730904. {{(pid=82600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2d2943-3daf-4367-9602-737762e5ae03]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_b3n5wl6k {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:01 devstack sudo[85437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_b3n5wl6k Apr 15 10:08:01 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:02 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6f04df92-4974-4742-a850-e57f1e06008f" returned: 0 in 0.743s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Lock "cinder-quobyte-6f04df92-4974-4742-a850-e57f1e06008f" released by "delete_volume" :: held 1.474s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Created reservations ['4fd07a9b-a6ff-4a6e-838f-252cd7c46647', '6def81a4-f936-47da-9ea3-8363cfbfb2b5', 'aa6c595d-3e8d-4b7a-b291-2a1d16c6987d', 'f5fd0d37-fb54-43d0-8d49-40c1f1163b87'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:02 devstack sudo[85440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:02 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:02 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_b3n5wl6k" returned: 0 in 0.849s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_b3n5wl6k {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:02 devstack sudo[85444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_b3n5wl6k Apr 15 10:08:02 devstack sudo[85444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:03 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.849s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:03 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:03 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Deleted volume successfully. Apr 15 10:08:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-59f0bd8c-dc81-4018-8476-a2dc7559f311 tempest-VolumesTestJSON-1683723084 None] Lock "cinder-6f04df92-4974-4742-a850-e57f1e06008f-delete_volume" released by "delete_volume" :: held 2.617s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:03 devstack sudo[85444]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_b3n5wl6k" returned: 1 in 0.870s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_b3n5wl6k' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:08:03 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[01515411-ea9d-4dfe-96b7-a7cb1624a419]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:03 devstack sudo[85449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD Apr 15 10:08:03 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:04 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ca10b3c5-5ea2-41bd-8603-68d696f57a1f tempest-GroupsV314Test-1954360257 None] Group tempest-GroupsV314Test-Group-1310430348: creating Apr 15 10:08:04 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 was qcow2, converting to raw {{(pid=82600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:08:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:04 devstack sudo[85454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 Apr 15 10:08:04 devstack sudo[85454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ca10b3c5-5ea2-41bd-8603-68d696f57a1f tempest-GroupsV314Test-1954360257 None] Group tempest-GroupsV314Test-Group-1310430348: created successfully Apr 15 10:08:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ca10b3c5-5ea2-41bd-8603-68d696f57a1f tempest-GroupsV314Test-1954360257 None] Create group completed successfully. Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Acquiring lock "cinder-e2482396-cf44-4b63-b813-147ab2b1a270-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Lock "cinder-e2482396-cf44-4b63-b813-147ab2b1a270-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Acquiring lock "cinder-quobyte-e2482396-cf44-4b63-b813-147ab2b1a270" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Lock "cinder-quobyte-e2482396-cf44-4b63-b813-147ab2b1a270" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b1f955-c1f0-4de1-a8a4-61531f4269dd]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:05 devstack sudo[85472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 Apr 15 10:08:05 devstack sudo[85472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:05 devstack sudo[85454]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904" returned: 0 in 1.572s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_iq5qmdntdevstack@QuobyteHD, size 112.00 MB, duration 1.57 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:08:05 devstack cinder-volume[82600]: INFO cinder.image.image_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Converted 112.00 MB image at 71.15 MB/s Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:05 devstack sudo[85474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 1G Apr 15 10:08:05 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:05 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Flow 'volume_create_manager' (b583f821-1c28-4f3e-a047-d3e55dcd77c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38eef52d-adfd-427e-963f-1c4ffdd78e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38eef52d-adfd-427e-963f-1c4ffdd78e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512159129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0dc662f4-d40b-4cde-a2e3-cda95d9d0854,host='devstack@QuobyteHD#QuobyteHD',id=6d7c2304-962a-4eec-a19c-e0f38553cd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd65f37b26f14eb8aaab4c765f1915b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:06Z,use_quota=True,user_id='7d98f1211d1848ceba86c7cebdb68d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(083e4bda-9c93-4a37-8f2c-75bba9882835),volume_type_id=083e4bda-9c93-4a37-8f2c-75bba9882835)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae65c12-afc7-4dcf-9062-6b883a5a9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae65c12-afc7-4dcf-9062-6b883a5a9684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7c8c9-0ed7-497d-9a57-54e0c8de38ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3f7c8c9-0ed7-497d-9a57-54e0c8de38ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7c2304-962a-4eec-a19c-e0f38553cd04', 'volume_name': 'volume-6d7c2304-962a-4eec-a19c-e0f38553cd04', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde4169b-e435-43f1-baeb-30e13d707fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dde4169b-e435-43f1-baeb-30e13d707fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197d4fea-f676-4661-9f4d-cff3af6a49b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:06 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Volume 6d7c2304-962a-4eec-a19c-e0f38553cd04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7c2304-962a-4eec-a19c-e0f38553cd04', 'volume_size': 1} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0dc662f4-d40b-4cde-a2e3-cda95d9d0854,created_at=2026-04-15T08:08:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-512159129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0dc662f4-d40b-4cde-a2e3-cda95d9d0854,host='devstack@QuobyteHD#QuobyteHD',id=6d7c2304-962a-4eec-a19c-e0f38553cd04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd65f37b26f14eb8aaab4c765f1915b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:06Z,use_quota=True,user_id='7d98f1211d1848ceba86c7cebdb68d38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(083e4bda-9c93-4a37-8f2c-75bba9882835),volume_type_id=083e4bda-9c93-4a37-8f2c-75bba9882835)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Creating volume 6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:06 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:06 devstack sudo[85476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 1073741824 Apr 15 10:08:06 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:06 devstack sudo[85472]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270" returned: 0 in 0.786s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:06 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270 Apr 15 10:08:06 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:06 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 1G" returned: 0 in 0.953s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b07985-e111-436d-9e03-ef32c2b6f889]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:06 devstack sudo[85490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 Apr 15 10:08:06 devstack sudo[85490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:07 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 1073741824" returned: 0 in 0.940s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:07 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 Apr 15 10:08:07 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:07 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e2482396-cf44-4b63-b813-147ab2b1a270" returned: 0 in 0.960s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Lock "cinder-quobyte-e2482396-cf44-4b63-b813-147ab2b1a270" released by "delete_volume" :: held 1.836s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Created reservations ['ecbc96b8-f9b8-48c7-b0d1-88d7c5b386cc', 'a85d74ea-71f5-449c-9542-f38d68fa21c3', 'c5f75891-d400-4c14-9fc2-59ed33f9eac9', '0b218d8d-fb94-4932-b412-6ca120e0d234'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:07 devstack sudo[85498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:07 devstack sudo[85498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:07 devstack sudo[85490]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904" returned: 0 in 0.952s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:07 devstack sudo[85504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 Apr 15 10:08:07 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:08 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04" returned: 0 in 0.894s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (197d4fea-f676-4661-9f4d-cff3af6a49b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7c2304-962a-4eec-a19c-e0f38553cd04', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552dc803-98cd-4506-9461-19e8bdf7b940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:08 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Volume volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 (6d7c2304-962a-4eec-a19c-e0f38553cd04): created successfully Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (552dc803-98cd-4506-9461-19e8bdf7b940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Flow 'volume_create_manager' (b583f821-1c28-4f3e-a047-d3e55dcd77c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:08 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-67a3256a-bd44-42a5-b82f-371373937656 tempest-GroupsV314Test-1954360257 None] Created volume successfully. Apr 15 10:08:08 devstack sudo[85498]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.906s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:08 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Deleted volume successfully. Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fb12c7c3-6161-40df-bf5f-db368a92470a tempest-DeleteServersTestJSON-456247990 None] Lock "cinder-e2482396-cf44-4b63-b813-147ab2b1a270-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:08 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904" returned: 1 in 1.095s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Downloaded image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}])) to volume 32b605d9-1620-469e-8cff-b3c2d2730904 successfully. {{(pid=82600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Temporary image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 for user baf60878e7b24875ae2c67810b2ad186 is deleted. {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Marking volume 32b605d9-1620-469e-8cff-b3c2d2730904 as bootable. {{(pid=82600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Copying metadata from image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 to 32b605d9-1620-469e-8cff-b3c2d2730904. {{(pid=82600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Creating volume glance metadata for volume 32b605d9-1620-469e-8cff-b3c2d2730904 backed by image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:UPDATE=84,cinder:SELECT=72,cinder:INSERT=19,cinder:DELETE=8 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0080b2c2-f7e3-4ec8-9b0d-af347afcbb5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32b605d9-1620-469e-8cff-b3c2d2730904', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58691a00-00e6-47b8-85cb-0ce9374f611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:08 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Volume volume-32b605d9-1620-469e-8cff-b3c2d2730904 (32b605d9-1620-469e-8cff-b3c2d2730904): created successfully Apr 15 10:08:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58691a00-00e6-47b8-85cb-0ce9374f611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Flow 'volume_create_manager' (46c77190-caad-42b7-b73d-6c6253bc5868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:09 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ff839289-3056-4b14-ad5a-24d2a3979740 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Created volume successfully. Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:10 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:10 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:10 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Cloning volume 6d7c2304-962a-4eec-a19c-e0f38553cd04 to volume 1de17ca6-5f02-4ec1-9db8-b109087ff090 Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Creating offline snapshot 88bae43d-7ecb-4379-8c1a-1efe6a77c560 of volume 6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5c789f-26f1-432a-ba2f-65134b335b4f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:10 devstack sudo[85523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 Apr 15 10:08:10 devstack sudo[85523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:11 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.825s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:11 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:11 devstack sudo[85523]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04" returned: 0 in 0.706s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:11 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 1G Apr 15 10:08:11 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:12 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 1G" returned: 0 in 0.648s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:12 devstack sudo[85543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 Apr 15 10:08:12 devstack sudo[85543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:12 devstack sudo[85543]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560" returned: 0 in 0.648s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:12 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:08:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:12 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 Apr 15 10:08:12 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-79c009e1-68e8-4f1e-8418-5a656950d4cf tempest-GroupsV320Test-517745429 None] Group tempest-GroupsV320Test-Group-1831616255: creating Apr 15 10:08:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-79c009e1-68e8-4f1e-8418-5a656950d4cf tempest-GroupsV320Test-517745429 None] Group tempest-GroupsV320Test-Group-1831616255: created successfully Apr 15 10:08:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-79c009e1-68e8-4f1e-8418-5a656950d4cf tempest-GroupsV320Test-517745429 None] Create group completed successfully. Apr 15 10:08:13 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560" returned: 0 in 0.587s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:13 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.info Apr 15 10:08:13 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:13 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] Created reservations ['b310b8ae-6566-49f3-b1e7-4c077bed230c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:13 devstack sudo[85555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:13 devstack sudo[85555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:14 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.info" returned: 0 in 0.722s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:14 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:14 devstack sudo[85557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.info Apr 15 10:08:14 devstack sudo[85557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:14 devstack sudo[85555]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.545s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:14 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ef68e72b-d919-4255-8639-0cc0ce21f520 tempest-GroupsV320Test-517745429 None] Delete group completed successfully. Apr 15 10:08:14 devstack sudo[85557]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.info" returned: 0 in 0.574s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Acquiring lock "cinder-quobyte-1de17ca6-5f02-4ec1-9db8-b109087ff090" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Lock "cinder-quobyte-1de17ca6-5f02-4ec1-9db8-b109087ff090" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] snapshot: 88bae43d-7ecb-4379-8c1a-1efe6a77c560, volume: 1de17ca6-5f02-4ec1-9db8-b109087ff090, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dbcca6-26e0-4974-9d3b-45a0d2debc19]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:14 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 Apr 15 10:08:14 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:15 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560" returned: 0 in 0.664s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7c2304-962a-4eec-a19c-e0f38553cd04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c31a65-f78b-45bb-8c1e-a7c1c2b6e978]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:15 devstack sudo[85566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 Apr 15 10:08:15 devstack sudo[85566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=82,cinder:DELETE=6,cinder:INSERT=32,cinder:UPDATE=93 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:08:15 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4b87223f-1fea-4fd8-a195-887571cebf4c tempest-GroupsTest-468198482 None] Group tempest-Group1-186102026: creating Apr 15 10:08:15 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4b87223f-1fea-4fd8-a195-887571cebf4c tempest-GroupsTest-468198482 None] Group tempest-Group1-186102026: created successfully Apr 15 10:08:15 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4b87223f-1fea-4fd8-a195-887571cebf4c tempest-GroupsTest-468198482 None] Create group completed successfully. Apr 15 10:08:15 devstack sudo[85566]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04" returned: 0 in 0.649s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:08:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:15 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 Apr 15 10:08:15 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:17 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-3caf436b-7293-433a-a05c-be48e224bfdd tempest-GroupsTest-468198482 None] Group tempest-Group2-1680918243: creating Apr 15 10:08:17 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-3caf436b-7293-433a-a05c-be48e224bfdd tempest-GroupsTest-468198482 None] Group tempest-Group2-1680918243: created successfully Apr 15 10:08:17 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-3caf436b-7293-433a-a05c-be48e224bfdd tempest-GroupsTest-468198482 None] Create group completed successfully. Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Flow 'volume_create_manager' (86689aaf-afd5-4624-ad05-0a34df266c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:19 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b60ff92-76b8-4aca-9e0c-a5e8494b74ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090" returned: 0 in 3.340s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b60ff92-76b8-4aca-9e0c-a5e8494b74ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480054786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5426d0b-c3bc-44bf-b95a-ec2bd0bfec4b,host='devstack@QuobyteHD#QuobyteHD',id=5512baed-f586-4eec-a25c-261df9c31b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb6bfec4d144890ab231f5bce64d433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:19Z,use_quota=True,user_id='1b5edede5b984aee85c267aa97783fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93175325-c44a-448a-a821-fbc08b004592),volume_type_id=93175325-c44a-448a-a821-fbc08b004592)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5dd029d-9bac-45c3-b119-70285ccc1cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5dd029d-9bac-45c3-b119-70285ccc1cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a908891-1781-4fa2-9191-2ff53720ec9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a908891-1781-4fa2-9191-2ff53720ec9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5512baed-f586-4eec-a25c-261df9c31b46', 'volume_name': 'volume-5512baed-f586-4eec-a25c-261df9c31b46', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f126bf40-c1b0-443e-9504-49ec6a5495e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f126bf40-c1b0-443e-9504-49ec6a5495e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a6701-c319-4451-857b-db4e1afed262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:19 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Volume 5512baed-f586-4eec-a25c-261df9c31b46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5512baed-f586-4eec-a25c-261df9c31b46', 'volume_size': 1} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb1f534-851c-4649-a724-1e176cae716a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:19 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 Apr 15 10:08:19 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:20 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04" returned: 0 in 0.750s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04, size 1024.00 MB, duration 3.34 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:08:20 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Converted 1024.00 MB image at 306.56 MB/s Apr 15 10:08:20 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:20 devstack sudo[85603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 Apr 15 10:08:20 devstack sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:20 devstack sudo[85603]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090" returned: 0 in 0.569s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Lock "cinder-quobyte-1de17ca6-5f02-4ec1-9db8-b109087ff090" released by "_copy_volume_from_snapshot" :: held 6.084s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Acquiring lock "cinder-quobyte-88bae43d-7ecb-4379-8c1a-1efe6a77c560" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Lock "cinder-quobyte-88bae43d-7ecb-4379-8c1a-1efe6a77c560" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Deleting offline snapshot 88bae43d-7ecb-4379-8c1a-1efe6a77c560 of volume 6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] snapshot_file for this snap is: volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[43715558-01aa-4c3c-b33e-a41ddba1a2aa]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:20 devstack sudo[85606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 Apr 15 10:08:20 devstack sudo[85606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:21 devstack sudo[85606]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560" returned: 0 in 0.556s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7c2304-962a-4eec-a19c-e0f38553cd04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:08:21 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc316b4-78d4-46cd-8ef5-4433af3abab1]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:21 devstack sudo[85611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 Apr 15 10:08:21 devstack sudo[85611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:21 devstack sudo[85611]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04" returned: 0 in 0.599s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:21 devstack sudo[85617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 Apr 15 10:08:21 devstack sudo[85617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Flow 'volume_create_manager' (478481be-8ecb-4e7e-a123-1e887af31dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab5e566-9437-4cbf-a928-2209ef07396a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab5e566-9437-4cbf-a928-2209ef07396a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1861347413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09d997f-e570-49ed-a4ec-65bea1732096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677377b64cb545529a12f5a04384bc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:22Z,use_quota=True,user_id='db0898fae14947d6a5cdf333ef956beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1f099f-114e-4487-802c-6e3cc0cdcf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe1f099f-114e-4487-802c-6e3cc0cdcf78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdeedf8-fcd3-4c70-8909-298b57c04d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fdeedf8-fcd3-4c70-8909-298b57c04d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09d997f-e570-49ed-a4ec-65bea1732096', 'volume_name': 'volume-c09d997f-e570-49ed-a4ec-65bea1732096', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0064d27f-bee5-402e-9361-3a34ee8effbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0064d27f-bee5-402e-9361-3a34ee8effbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3643657c-4b3a-4b87-9dc3-43bf5dcea48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:22 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Volume c09d997f-e570-49ed-a4ec-65bea1732096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09d997f-e570-49ed-a4ec-65bea1732096', 'volume_size': 1} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:22 devstack sudo[85617]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560" returned: 0 in 0.547s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:22 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560 Apr 15 10:08:22 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:22 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04.88bae43d-7ecb-4379-8c1a-1efe6a77c560" returned: 0 in 0.481s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Lock "cinder-quobyte-88bae43d-7ecb-4379-8c1a-1efe6a77c560" released by "_delete_snapshot" :: held 2.237s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.378s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.426s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:23 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee5c986-c5ff-4b65-a59b-75d06d447a99]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:23 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0e96a46c-fddc-4def-bb3d-f5301d9d0736 tempest-GroupsV314Test-1954360257 None] Create group from source-group-0dc662f4-d40b-4cde-a2e3-cda95d9d0854 completed successfully. Apr 15 10:08:23 devstack sudo[85626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 Apr 15 10:08:23 devstack sudo[85626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:23 devstack sudo[85626]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904" returned: 0 in 0.545s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:23 devstack sudo[85630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 Apr 15 10:08:23 devstack sudo[85630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Acquiring lock "cinder-quobyte-1de17ca6-5f02-4ec1-9db8-b109087ff090" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Lock "cinder-quobyte-1de17ca6-5f02-4ec1-9db8-b109087ff090" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:23 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b278327-2779-4d24-bd53-a149ef602b75]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:23 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 Apr 15 10:08:23 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:24 devstack sudo[85630]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904" returned: 1 in 0.561s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.143s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.768s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e5426d0b-c3bc-44bf-b95a-ec2bd0bfec4b,created_at=2026-04-15T08:08:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-480054786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e5426d0b-c3bc-44bf-b95a-ec2bd0bfec4b,host='devstack@QuobyteHD#QuobyteHD',id=5512baed-f586-4eec-a25c-261df9c31b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb6bfec4d144890ab231f5bce64d433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:19Z,use_quota=True,user_id='1b5edede5b984aee85c267aa97783fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(93175325-c44a-448a-a821-fbc08b004592),volume_type_id=93175325-c44a-448a-a821-fbc08b004592)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Creating volume 5512baed-f586-4eec-a25c-261df9c31b46 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:24 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:24 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46 1073741824 Apr 15 10:08:24 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c', 'name': 'volume-32b605d9-1620-469e-8cff-b3c2d2730904', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a335462d-9365-4d36-9710-a5b15cf21fb7', 'enforce_multipath': True} {{(pid=82600) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 15 10:08:24 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-23bf01ca-8fac-4f2b-a8c4-6455dca69756 req-ac9c9597-2dd0-4867-9f26-3c73c5cc61d3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] attachment_update completed successfully. Apr 15 10:08:24 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090" returned: 0 in 0.567s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:24 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090 Apr 15 10:08:24 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:24 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46 1073741824" returned: 0 in 0.675s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:24 devstack sudo[85648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46 Apr 15 10:08:24 devstack sudo[85648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:24 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1de17ca6-5f02-4ec1-9db8-b109087ff090" returned: 0 in 0.568s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Lock "cinder-quobyte-1de17ca6-5f02-4ec1-9db8-b109087ff090" released by "delete_volume" :: held 1.163s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:24 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Created reservations ['9a5645cf-0763-48b3-ba50-c19490e98fd5'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:25 devstack cinder-volume[82600]: WARNING cinder.quota [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-882467911 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-882467911, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:08:25 devstack cinder-volume[82600]: WARNING cinder.quota [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-882467911 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-882467911, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Created reservations ['9ba3db08-1421-481f-992e-9d3162ab88fa', '52c43226-1848-4bf5-9155-a453e19790bd', 'cc3e1dfa-e767-4919-b302-b0fcc65b4e67', 'ddf63070-b81f-4359-81ca-050e35344f9b'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:25 devstack sudo[85650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:25 devstack sudo[85650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:25 devstack sudo[85648]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46" returned: 0 in 0.538s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.100s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1861347413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c09d997f-e570-49ed-a4ec-65bea1732096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677377b64cb545529a12f5a04384bc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:22Z,use_quota=True,user_id='db0898fae14947d6a5cdf333ef956beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Creating volume c09d997f-e570-49ed-a4ec-65bea1732096 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:25 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d0a6701-c319-4451-857b-db4e1afed262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5512baed-f586-4eec-a25c-261df9c31b46', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7809d0af-d2dd-4ea7-abcc-314477dbb4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:25 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Volume volume-5512baed-f586-4eec-a25c-261df9c31b46 (5512baed-f586-4eec-a25c-261df9c31b46): created successfully Apr 15 10:08:25 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096 1073741824 Apr 15 10:08:25 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7809d0af-d2dd-4ea7-abcc-314477dbb4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Flow 'volume_create_manager' (86689aaf-afd5-4624-ad05-0a34df266c2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:25 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cc60d85c-1a7a-4755-802f-8de5865870dc tempest-GroupsTest-468198482 None] Created volume successfully. Apr 15 10:08:25 devstack sudo[85650]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.489s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:25 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:25 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f614b110-0776-4a50-b8f4-d48394949ed5 tempest-GroupsV314Test-1954360257 None] Delete group completed successfully. Apr 15 10:08:26 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096 1073741824" returned: 0 in 0.661s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:26 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096 Apr 15 10:08:26 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Acquiring lock "cinder-quobyte-6d7c2304-962a-4eec-a19c-e0f38553cd04" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Lock "cinder-quobyte-6d7c2304-962a-4eec-a19c-e0f38553cd04" acquired by "delete_volume" :: waited 0.029s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd1c711-cca8-4289-8ece-e81ed48be073]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Acquiring lock "cinder-quobyte-5512baed-f586-4eec-a25c-261df9c31b46" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Lock "cinder-quobyte-5512baed-f586-4eec-a25c-261df9c31b46" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f36649d-0747-44a6-90a9-c0e00ce3587d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:26 devstack sudo[85661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 Apr 15 10:08:26 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:26 devstack sudo[85662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46 Apr 15 10:08:26 devstack sudo[85662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:26 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096" returned: 0 in 0.521s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3643657c-4b3a-4b87-9dc3-43bf5dcea48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09d997f-e570-49ed-a4ec-65bea1732096', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c98a6e-224b-46cd-9d86-2fbd980f9a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:26 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Volume volume-c09d997f-e570-49ed-a4ec-65bea1732096 (c09d997f-e570-49ed-a4ec-65bea1732096): created successfully Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49c98a6e-224b-46cd-9d86-2fbd980f9a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Flow 'volume_create_manager' (478481be-8ecb-4e7e-a123-1e887af31dda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:26 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0799eb8f-4833-4c3f-9e49-80f8f8d851dc tempest-VolumeQuotasAdminTestJSON-145165800 None] Created volume successfully. Apr 15 10:08:26 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04" returned: 0 in 0.605s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:26 devstack sudo[85672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04 Apr 15 10:08:26 devstack sudo[85672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:26 devstack sudo[85662]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46" returned: 0 in 0.561s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:26 devstack sudo[85674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46 Apr 15 10:08:26 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:27 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5512baed-f586-4eec-a25c-261df9c31b46" returned: 0 in 0.453s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Lock "cinder-quobyte-5512baed-f586-4eec-a25c-261df9c31b46" released by "delete_volume" :: held 1.040s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:27 devstack sudo[85672]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6d7c2304-962a-4eec-a19c-e0f38553cd04" returned: 0 in 0.520s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Lock "cinder-quobyte-6d7c2304-962a-4eec-a19c-e0f38553cd04" released by "delete_volume" :: held 1.180s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Created reservations ['1995f201-19ef-4dd8-9af7-84505ff71216'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Created reservations ['f289bc6c-4184-43a1-8028-e9d0e2394903'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:27 devstack cinder-volume[82600]: WARNING cinder.quota [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1086596845 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1086596845, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:08:27 devstack cinder-volume[82600]: WARNING cinder.quota [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1086596845 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1086596845, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Created reservations ['2ddf7cc4-e84a-4149-8add-ced4ae901511', '5af0d9ff-621d-42b6-958d-bef384a90e61', '4fd987f2-4a5b-451b-b54f-811d26f6f08c', '51b95f92-fa95-4a54-bdf8-d047cfaeb58a'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Created reservations ['fae257ca-1f25-41f8-9b80-adeb0a2b38c7', '3ece675a-73cb-4bfc-83d3-5e46a063bd0a', 'b29658d6-963a-4560-a8d1-e09f860cb9ce', '820077de-d290-4dc9-8609-3bbcb24a3431'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:27 devstack sudo[85681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:27 devstack sudo[85681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Acquiring lock "cinder-c09d997f-e570-49ed-a4ec-65bea1732096-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "cinder-c09d997f-e570-49ed-a4ec-65bea1732096-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Acquiring lock "cinder-quobyte-c09d997f-e570-49ed-a4ec-65bea1732096" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "cinder-quobyte-c09d997f-e570-49ed-a4ec-65bea1732096" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bf2cef-26e6-465a-9913-a153782c6fcb]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:27 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:27 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:27 devstack sudo[85683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096 Apr 15 10:08:27 devstack sudo[85683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:28 devstack sudo[85681]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.500s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:28 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f7e858c7-63d6-45dc-9835-78d0142b1627 tempest-GroupsTest-468198482 None] Delete group completed successfully. Apr 15 10:08:28 devstack sudo[85683]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096" returned: 0 in 0.536s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:28 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:28 devstack sudo[85692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096 Apr 15 10:08:28 devstack sudo[85692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.535s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:28 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a55bf258-d09a-49db-b1b6-2b8666c97278 tempest-GroupsV314Test-1954360257 None] Delete group completed successfully. Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] Created reservations ['84c2da11-2599-4919-a23a-fa7964c29d2a'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:28 devstack sudo[85694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:28 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:28 devstack sudo[85692]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c09d997f-e570-49ed-a4ec-65bea1732096" returned: 0 in 0.550s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "cinder-quobyte-c09d997f-e570-49ed-a4ec-65bea1732096" released by "delete_volume" :: held 1.109s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:28 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Created reservations ['28ec026d-09f7-45ec-9581-892fd72589b1', 'eb5f7873-6b6f-4a76-9f0a-18dea893a4ae', '15d32123-5467-448d-af71-a5dd43abc46a', 'e50493a9-71f9-4aca-985c-a3db9a7bf31b'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:29 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:29 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:29 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.653s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:29 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-49e3840d-e4e5-4cd0-9b26-0d74d9e030af tempest-GroupsTest-468198482 None] Delete group completed successfully. Apr 15 10:08:29 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.861s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:29 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:29 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Deleted volume successfully. Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-825f2d5f-4bbd-447f-b1fe-d21ad20c8e92 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "cinder-c09d997f-e570-49ed-a4ec-65bea1732096-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ba5346c4-8eb5-4790-9051-ac21b9a10a23 tempest-GroupsTest-468198482 None] Group tempest-GroupsTest-Group-1446907848: creating Apr 15 10:08:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ba5346c4-8eb5-4790-9051-ac21b9a10a23 tempest-GroupsTest-468198482 None] Group tempest-GroupsTest-Group-1446907848: created successfully Apr 15 10:08:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ba5346c4-8eb5-4790-9051-ac21b9a10a23 tempest-GroupsTest-468198482 None] Create group completed successfully. Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Flow 'volume_create_manager' (cd8fc4d1-6d10-4ace-8a1b-e05c6dd576f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dd2551-a32a-465c-92cc-58919a2aec94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02dd2551-a32a-465c-92cc-58919a2aec94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1472702304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6d8ee2-8d4c-4506-9d78-3227212175a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677377b64cb545529a12f5a04384bc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:31Z,use_quota=True,user_id='db0898fae14947d6a5cdf333ef956beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc4fc32-7da3-4546-90ef-a4d3a5a04b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cc4fc32-7da3-4546-90ef-a4d3a5a04b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b72bb3f-5925-468f-b61a-aaf577879c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b72bb3f-5925-468f-b61a-aaf577879c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb6d8ee2-8d4c-4506-9d78-3227212175a8', 'volume_name': 'volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fffb26-4a3d-4d90-8189-a7881b20ad64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3fffb26-4a3d-4d90-8189-a7881b20ad64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e45aa7d-e6d8-4b0f-a833-a9b5756a0f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:30 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Volume fb6d8ee2-8d4c-4506-9d78-3227212175a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8', 'volume_size': 1} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1472702304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb6d8ee2-8d4c-4506-9d78-3227212175a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677377b64cb545529a12f5a04384bc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:31Z,use_quota=True,user_id='db0898fae14947d6a5cdf333ef956beb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Creating volume fb6d8ee2-8d4c-4506-9d78-3227212175a8 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:30 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:30 devstack sudo[85730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 1073741824 Apr 15 10:08:30 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:31 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 1073741824" returned: 0 in 0.962s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:31 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 Apr 15 10:08:31 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Flow 'volume_create_manager' (c1747748-2aed-4daa-8bde-000fd3ce3347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1119d02-0b6c-4c01-bb15-b5488ae9670b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1119d02-0b6c-4c01-bb15-b5488ae9670b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381282106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d60ad0ba-519f-4f7e-a672-f191164a8064,host='devstack@QuobyteHD#QuobyteHD',id=7616ff04-adb5-42cd-b018-603c0c63c207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb6bfec4d144890ab231f5bce64d433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:32Z,use_quota=True,user_id='1b5edede5b984aee85c267aa97783fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f28c1ea8-cbf5-4b0f-b5d6-8a82cf932d68),volume_type_id=f28c1ea8-cbf5-4b0f-b5d6-8a82cf932d68)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aec5b11-19e8-4a6a-af7f-007fad123e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aec5b11-19e8-4a6a-af7f-007fad123e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e614bd-1c68-4e6b-9376-e5431a765f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1e614bd-1c68-4e6b-9376-e5431a765f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7616ff04-adb5-42cd-b018-603c0c63c207', 'volume_name': 'volume-7616ff04-adb5-42cd-b018-603c0c63c207', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7489f16f-b18e-4a30-a2ac-692d3fadf048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7489f16f-b18e-4a30-a2ac-692d3fadf048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f74ed2-a0dc-45d5-96aa-ca42b9d118d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:32 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Volume 7616ff04-adb5-42cd-b018-603c0c63c207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7616ff04-adb5-42cd-b018-603c0c63c207', 'volume_size': 1} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:32 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8" returned: 0 in 0.729s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d60ad0ba-519f-4f7e-a672-f191164a8064,created_at=2026-04-15T08:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381282106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d60ad0ba-519f-4f7e-a672-f191164a8064,host='devstack@QuobyteHD#QuobyteHD',id=7616ff04-adb5-42cd-b018-603c0c63c207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb6bfec4d144890ab231f5bce64d433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:32Z,use_quota=True,user_id='1b5edede5b984aee85c267aa97783fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f28c1ea8-cbf5-4b0f-b5d6-8a82cf932d68),volume_type_id=f28c1ea8-cbf5-4b0f-b5d6-8a82cf932d68)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Creating volume 7616ff04-adb5-42cd-b018-603c0c63c207 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:32 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e45aa7d-e6d8-4b0f-a833-a9b5756a0f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87337972-396c-41a6-98db-c9519d373118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:32 devstack sudo[85742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207 1073741824 Apr 15 10:08:32 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:32 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Volume volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 (fb6d8ee2-8d4c-4506-9d78-3227212175a8): created successfully Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87337972-396c-41a6-98db-c9519d373118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Flow 'volume_create_manager' (cd8fc4d1-6d10-4ace-8a1b-e05c6dd576f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:32 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0ce8d654-88e7-4ca4-ae71-07a220c22eb9 tempest-VolumeQuotasAdminTestJSON-145165800 None] Created volume successfully. Apr 15 10:08:33 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207 1073741824" returned: 0 in 0.801s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:33 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207 Apr 15 10:08:33 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:33 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e21558b0-7abd-40f6-b370-9e28ab92d811 tempest-VolumeQuotasAdminTestJSON-2146982814 None] Transfer volume completed successfully. Apr 15 10:08:34 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207" returned: 0 in 0.717s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f74ed2-a0dc-45d5-96aa-ca42b9d118d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7616ff04-adb5-42cd-b018-603c0c63c207', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f0e159-d117-402c-9f35-52be3f8f636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:34 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Volume volume-7616ff04-adb5-42cd-b018-603c0c63c207 (7616ff04-adb5-42cd-b018-603c0c63c207): created successfully Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98f0e159-d117-402c-9f35-52be3f8f636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Flow 'volume_create_manager' (c1747748-2aed-4daa-8bde-000fd3ce3347) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:34 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ea1467ce-1539-4be6-aad4-d3f7028f512e tempest-GroupsTest-468198482 None] Created volume successfully. Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Acquiring lock "cinder-fb6d8ee2-8d4c-4506-9d78-3227212175a8-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Lock "cinder-fb6d8ee2-8d4c-4506-9d78-3227212175a8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Acquiring lock "cinder-quobyte-fb6d8ee2-8d4c-4506-9d78-3227212175a8" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Lock "cinder-quobyte-fb6d8ee2-8d4c-4506-9d78-3227212175a8" acquired by "delete_volume" :: waited 0.030s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9c0f34-5365-45ac-871e-a4baa0b63148]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:35 devstack sudo[85751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 Apr 15 10:08:35 devstack sudo[85751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:35 devstack sudo[85751]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8" returned: 0 in 0.572s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:35 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8 Apr 15 10:08:35 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Flow 'volume_create_manager' (67fcff3c-7064-4641-b093-3054166864bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3952edf3-fd65-45ae-aa44-3d91fb6b0e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3952edf3-fd65-45ae-aa44-3d91fb6b0e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-345827589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d60ad0ba-519f-4f7e-a672-f191164a8064,host='devstack@QuobyteHD#QuobyteHD',id=9bcc0194-7ee6-4b88-ad2d-bf2466e77d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb6bfec4d144890ab231f5bce64d433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:36Z,use_quota=True,user_id='1b5edede5b984aee85c267aa97783fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f28c1ea8-cbf5-4b0f-b5d6-8a82cf932d68),volume_type_id=f28c1ea8-cbf5-4b0f-b5d6-8a82cf932d68)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be60816-d3f9-4728-8a1f-5810bfeab606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0be60816-d3f9-4728-8a1f-5810bfeab606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a94debc-de18-468d-96d7-9201a2340e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a94debc-de18-468d-96d7-9201a2340e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bcc0194-7ee6-4b88-ad2d-bf2466e77d16', 'volume_name': 'volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b45e71-6fbf-4c02-9c89-6bf29386c124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b45e71-6fbf-4c02-9c89-6bf29386c124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3229c387-cfd8-4d75-b654-d7ed4a35542a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:35 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Volume 9bcc0194-7ee6-4b88-ad2d-bf2466e77d16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16', 'volume_size': 1} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d60ad0ba-519f-4f7e-a672-f191164a8064,created_at=2026-04-15T08:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-345827589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d60ad0ba-519f-4f7e-a672-f191164a8064,host='devstack@QuobyteHD#QuobyteHD',id=9bcc0194-7ee6-4b88-ad2d-bf2466e77d16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cb6bfec4d144890ab231f5bce64d433',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:36Z,use_quota=True,user_id='1b5edede5b984aee85c267aa97783fb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f28c1ea8-cbf5-4b0f-b5d6-8a82cf932d68),volume_type_id=f28c1ea8-cbf5-4b0f-b5d6-8a82cf932d68)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Creating volume 9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:35 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:35 devstack sudo[85758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 1073741824 Apr 15 10:08:35 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:36 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fb6d8ee2-8d4c-4506-9d78-3227212175a8" returned: 0 in 0.690s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Lock "cinder-quobyte-fb6d8ee2-8d4c-4506-9d78-3227212175a8" released by "delete_volume" :: held 1.319s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Created reservations ['d630cb8e-dee1-4289-929f-6514685e79c9', '467b86eb-ac27-4f37-b39b-9464b7819429', '046b7b07-3dba-4788-abac-10a040aedf5a', 'ff8215dc-7abd-44b0-ba10-7bb7d2a11d19'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:36 devstack sudo[85761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:36 devstack sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:36 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 1073741824" returned: 0 in 0.814s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:36 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 Apr 15 10:08:36 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:36 devstack sudo[85761]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.650s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:36 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Deleted volume successfully. Apr 15 10:08:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eeefaf58-d1c2-4d66-ba27-32b5d41f4a95 tempest-VolumeQuotasAdminTestJSON-891263988 None] Lock "cinder-fb6d8ee2-8d4c-4506-9d78-3227212175a8-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:37 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16" returned: 0 in 0.658s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3229c387-cfd8-4d75-b654-d7ed4a35542a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63e242b-9149-4c46-b605-abbe3d88c4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:37 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Volume volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 (9bcc0194-7ee6-4b88-ad2d-bf2466e77d16): created successfully Apr 15 10:08:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63e242b-9149-4c46-b605-abbe3d88c4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Flow 'volume_create_manager' (67fcff3c-7064-4641-b093-3054166864bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:37 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b3f0892c-927e-406d-87ad-89509432037f tempest-GroupsTest-468198482 None] Created volume successfully. Apr 15 10:08:38 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-9e7f6b3e-e429-4557-a16e-56a5b82c83c0 tempest-GroupsTest-468198482 None] Update group completed successfully. Apr 15 10:08:39 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-66e536de-6617-4f80-bbf4-13f4783fb5e2 tempest-GroupsTest-468198482 None] Update group completed successfully. Apr 15 10:08:40 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Acquiring lock "cinder-quobyte-7616ff04-adb5-42cd-b018-603c0c63c207" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:40 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Lock "cinder-quobyte-7616ff04-adb5-42cd-b018-603c0c63c207" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:40 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[795953b6-1d3b-40b5-97c7-0188526c793d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:40 devstack sudo[85813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207 Apr 15 10:08:40 devstack sudo[85813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:41 devstack sudo[85813]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207" returned: 0 in 0.727s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:41 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207 Apr 15 10:08:41 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:42 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7616ff04-adb5-42cd-b018-603c0c63c207" returned: 0 in 0.504s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Lock "cinder-quobyte-7616ff04-adb5-42cd-b018-603c0c63c207" released by "delete_volume" :: held 1.257s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Acquiring lock "cinder-quobyte-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Lock "cinder-quobyte-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:42 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3540231-b32a-49cc-b5e8-31b950ae628e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:42 devstack sudo[85823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 Apr 15 10:08:42 devstack sudo[85823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:42 devstack sudo[85823]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16" returned: 0 in 0.553s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:42 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16 Apr 15 10:08:42 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Flow 'volume_create_manager' (6fbfc07c-e3be-45e6-9c8b-edf44926f8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe7fb6e-6fb8-41d4-982a-cc7aa3722936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe7fb6e-6fb8-41d4-982a-cc7aa3722936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-364997965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a334f28a-112c-4854-addc-99f1efc689e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef99ba88b5d4351b2106bbff2e4010a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:43Z,use_quota=True,user_id='706fb520e3c2423090c30203a8ae1406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce184d2a-8dce-4fe5-abb5-c384a3d0cfe3),volume_type_id=ce184d2a-8dce-4fe5-abb5-c384a3d0cfe3)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af9ece7-0692-4c4f-b0c5-617722775c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af9ece7-0692-4c4f-b0c5-617722775c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52504a91-83a7-40d2-9aa7-f1e25717220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52504a91-83a7-40d2-9aa7-f1e25717220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a334f28a-112c-4854-addc-99f1efc689e5', 'volume_name': 'volume-a334f28a-112c-4854-addc-99f1efc689e5', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bacdab-b25d-484c-ab44-92682642b677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56bacdab-b25d-484c-ab44-92682642b677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b078db-fec0-4120-8bc4-d7fa3b065b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:43 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Volume a334f28a-112c-4854-addc-99f1efc689e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a334f28a-112c-4854-addc-99f1efc689e5', 'volume_size': 1} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-364997965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a334f28a-112c-4854-addc-99f1efc689e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef99ba88b5d4351b2106bbff2e4010a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:43Z,use_quota=True,user_id='706fb520e3c2423090c30203a8ae1406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce184d2a-8dce-4fe5-abb5-c384a3d0cfe3),volume_type_id=ce184d2a-8dce-4fe5-abb5-c384a3d0cfe3)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Creating volume a334f28a-112c-4854-addc-99f1efc689e5 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:43 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:43 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5 1073741824 Apr 15 10:08:43 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:43 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16" returned: 0 in 0.582s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Lock "cinder-quobyte-9bcc0194-7ee6-4b88-ad2d-bf2466e77d16" released by "delete_volume" :: held 1.159s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Created reservations ['d3bdb2a9-b511-47a7-a651-3f08e3a08862'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:43 devstack cinder-volume[82600]: WARNING cinder.quota [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1204289600 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1204289600, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:08:43 devstack cinder-volume[82600]: WARNING cinder.quota [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1204289600 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1204289600, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Created reservations ['07f035c4-c2d8-4dc0-87b5-90cf2d210da7', '66ab26bc-b376-4440-b7eb-0adb53351dfe', 'ac23516d-1dc5-4cce-9941-0e52f5d51f52', '9c2cdc5f-a132-4b21-87a4-505d0b3b3afe'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Created reservations ['278de10f-f918-4461-96fe-579c611e96d1', 'bcfa2270-cf70-4b61-9367-49d9c2cb1bc5', '793c14c7-1445-4a79-9f5f-e3acf2f791b6', 'f57d83a9-de3e-48cb-acf3-5b5cd8caac65'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:43 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:43 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:44 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5 1073741824" returned: 0 in 0.835s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:44 devstack sudo[85865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5 Apr 15 10:08:44 devstack sudo[85865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:44 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.976s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:44 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:44 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e3fc83e4-7eb9-41bb-b2d2-7e9c5a8f0b00 tempest-GroupsTest-468198482 None] Delete group completed successfully. Apr 15 10:08:45 devstack sudo[85865]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5" returned: 0 in 0.974s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b078db-fec0-4120-8bc4-d7fa3b065b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a334f28a-112c-4854-addc-99f1efc689e5', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50eb7513-1e3a-4d5a-a67f-889fd9131192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:45 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Volume volume-a334f28a-112c-4854-addc-99f1efc689e5 (a334f28a-112c-4854-addc-99f1efc689e5): created successfully Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50eb7513-1e3a-4d5a-a67f-889fd9131192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Flow 'volume_create_manager' (6fbfc07c-e3be-45e6-9c8b-edf44926f8b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7d7bf252-7c7c-42f6-9c5a-cbf60fe2328f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Created volume successfully. Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-3a12f3b6-798b-48f6-975e-4c0ef5a4f23f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-3a12f3b6-798b-48f6-975e-4c0ef5a4f23f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-3a12f3b6-798b-48f6-975e-4c0ef5a4f23f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-3a12f3b6-798b-48f6-975e-4c0ef5a4f23f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-3a12f3b6-798b-48f6-975e-4c0ef5a4f23f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3a12f3b6-798b-48f6-975e-4c0ef5a4f23f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:45 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:45 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:46 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3a12f3b6-798b-48f6-975e-4c0ef5a4f23f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.835s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:46 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-3a12f3b6-798b-48f6-975e-4c0ef5a4f23f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:46 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-3a12f3b6-798b-48f6-975e-4c0ef5a4f23f tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Retype volume completed successfully. Apr 15 10:08:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Acquiring lock "cinder-a334f28a-112c-4854-addc-99f1efc689e5-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "cinder-a334f28a-112c-4854-addc-99f1efc689e5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Acquiring lock "cinder-quobyte-a334f28a-112c-4854-addc-99f1efc689e5" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "cinder-quobyte-a334f28a-112c-4854-addc-99f1efc689e5" acquired by "delete_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:47 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[812b193c-fd23-4008-a64e-d204984551a5]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:47 devstack sudo[85875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5 Apr 15 10:08:47 devstack sudo[85875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:48 devstack sudo[85875]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5" returned: 0 in 0.932s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:48 devstack sudo[85880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5 Apr 15 10:08:48 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:48 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a334f28a-112c-4854-addc-99f1efc689e5" returned: 0 in 0.686s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "cinder-quobyte-a334f28a-112c-4854-addc-99f1efc689e5" released by "delete_volume" :: held 1.658s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:48 devstack cinder-volume[82600]: WARNING cinder.quota [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:08:48 devstack cinder-volume[82600]: WARNING cinder.quota [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:08:48 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Created reservations ['03b72e7d-4a84-4c49-96c5-99acb3298640', '18911fb1-a38a-45fb-a042-de5dde5c17f9', '166809d4-d190-4d3a-bab5-f99e49a0b495', '66bfa994-f712-4331-9a4f-e6f347f9a61d'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:49 devstack sudo[85883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:49 devstack sudo[85883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:50 devstack sudo[85883]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.021s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:50 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:50 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Deleted volume successfully. Apr 15 10:08:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-173b08e3-5df1-4953-b142-a0a44d74f4fd tempest-VolumeRetypeWithoutMigrationTest-678031031 None] Lock "cinder-a334f28a-112c-4854-addc-99f1efc689e5-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:50 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Flow 'volume_create_manager' (16468f52-3b7f-4106-928a-9c90b8ac8e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a416c9-c079-4f8f-bc44-5fe453e10a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3a416c9-c079-4f8f-bc44-5fe453e10a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1691128967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be12087-b47f-424c-bcbe-3758c5245fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bef9502a11f4ccab77da79bbf04ee87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:51Z,use_quota=True,user_id='dbcf847f5493462e835641e1bb5f1b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639d24d3-92f1-403c-995a-65dec6d80351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (639d24d3-92f1-403c-995a-65dec6d80351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7f164a-fa17-40b6-a5c4-e316e80044c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7f164a-fa17-40b6-a5c4-e316e80044c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3be12087-b47f-424c-bcbe-3758c5245fbb', 'volume_name': 'volume-3be12087-b47f-424c-bcbe-3758c5245fbb', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca4871a-b3b5-4b3e-aae6-25c9aac221f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca4871a-b3b5-4b3e-aae6-25c9aac221f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2243bf2b-a55a-4d6b-bfab-b79ad318902e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:51 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Volume 3be12087-b47f-424c-bcbe-3758c5245fbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3be12087-b47f-424c-bcbe-3758c5245fbb', 'volume_size': 1} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1691128967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3be12087-b47f-424c-bcbe-3758c5245fbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0bef9502a11f4ccab77da79bbf04ee87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:51Z,use_quota=True,user_id='dbcf847f5493462e835641e1bb5f1b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Creating volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:51 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:51 devstack sudo[85943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb 1073741824 Apr 15 10:08:51 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:52 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb 1073741824" returned: 0 in 1.291s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:52 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb Apr 15 10:08:52 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:53 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb" returned: 0 in 0.760s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2243bf2b-a55a-4d6b-bfab-b79ad318902e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3be12087-b47f-424c-bcbe-3758c5245fbb', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31a3b6b-220c-49bb-ae20-b8610bd5e491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:53 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Volume volume-3be12087-b47f-424c-bcbe-3758c5245fbb (3be12087-b47f-424c-bcbe-3758c5245fbb): created successfully Apr 15 10:08:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31a3b6b-220c-49bb-ae20-b8610bd5e491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Flow 'volume_create_manager' (16468f52-3b7f-4106-928a-9c90b8ac8e91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:53 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7ca136a0-3cf5-4be1-a7c7-e4d06b455238 tempest-SnapshotsActionsTest-1372573577 None] Created volume successfully. Apr 15 10:08:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Creating offline snapshot 06243f92-f16b-4ca6-a635-092dc24734ba of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:08:54 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9e69dc-440c-4e5c-b5b6-3cb9a15e6862]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:54 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb Apr 15 10:08:54 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:55 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb" returned: 0 in 0.708s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:55 devstack sudo[85984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba 1G Apr 15 10:08:55 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:55 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba 1G" returned: 0 in 0.559s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:55 devstack sudo[85989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:08:55 devstack sudo[85989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Flow 'volume_create_manager' (d949a9ed-965c-4726-9586-ba0a7029579b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b248c46-36c8-466d-8a2d-8d0764b0a3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b248c46-36c8-466d-8a2d-8d0764b0a3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1429959725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652f30d1-699c-4629-96b3-c9d9b4102f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b955293cad0245dfa066074d7e8cbeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:56Z,use_quota=True,user_id='801de4a2f0054c20b68ae2f0153e2370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a626fd-bba4-4044-a689-8f425ae3fad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a626fd-bba4-4044-a689-8f425ae3fad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb67ebd-03b5-4935-a5e6-2adb9aa4cf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceb67ebd-03b5-4935-a5e6-2adb9aa4cf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '652f30d1-699c-4629-96b3-c9d9b4102f2f', 'volume_name': 'volume-652f30d1-699c-4629-96b3-c9d9b4102f2f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7766896-1677-44ef-9b7a-2feb0f14cc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7766896-1677-44ef-9b7a-2feb0f14cc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b97201-ae4c-43ce-a28c-29b88824ae8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:55 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Volume 652f30d1-699c-4629-96b3-c9d9b4102f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-652f30d1-699c-4629-96b3-c9d9b4102f2f', 'volume_size': 1} Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:55 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-7a40808b-ac71-47b8-910d-e0953a3f8b1d tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Terminate volume connection completed successfully. Apr 15 10:08:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-7a40808b-ac71-47b8-910d-e0953a3f8b1d tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Deleting attachment a335462d-9365-4d36-9710-a5b15cf21fb7. {{(pid=82600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 10:08:56 devstack sudo[85989]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.567s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:56 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba is being set with open permissions: ugo+rw Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:56 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:08:56 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "cinder-32b605d9-1620-469e-8cff-b3c2d2730904-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "cinder-32b605d9-1620-469e-8cff-b3c2d2730904-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "cinder-quobyte-32b605d9-1620-469e-8cff-b3c2d2730904" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "cinder-quobyte-32b605d9-1620-469e-8cff-b3c2d2730904" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9323f2e7-9e81-4a12-8156-216b119d64b7]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:56 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.547s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:56 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 Apr 15 10:08:56 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:56 devstack sudo[86000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.info Apr 15 10:08:56 devstack sudo[86000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Flow 'volume_create_manager' (50d2643a-c84e-4c06-b977-5101f6c00c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5066be19-1766-47f0-ba66-e0e2fd082202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5066be19-1766-47f0-ba66-e0e2fd082202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-844692866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4a110a-afc7-4660-b433-31906ff1a076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1043062ac21b4c8a87f6bdebcc5ee3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:57Z,use_quota=True,user_id='3b4e14c8d50648fa92140f907d758fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a174eb-cb75-4d77-b9b2-f71954f88ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a174eb-cb75-4d77-b9b2-f71954f88ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f76cc6-37bb-45d5-a9e1-946b3b12894c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f76cc6-37bb-45d5-a9e1-946b3b12894c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b4a110a-afc7-4660-b433-31906ff1a076', 'volume_name': 'volume-3b4a110a-afc7-4660-b433-31906ff1a076', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4404347a-a9e6-4ebd-98f2-18989d959379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4404347a-a9e6-4ebd-98f2-18989d959379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae40d49-6293-4890-b687-f522d4cb1aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:57 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Volume 3b4a110a-afc7-4660-b433-31906ff1a076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b4a110a-afc7-4660-b433-31906ff1a076', 'volume_size': 1} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:57 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904" returned: 0 in 0.613s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:57 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 Apr 15 10:08:57 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:57 devstack sudo[86000]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.info" returned: 0 in 0.619s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:57 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.info is being set with open permissions: ugo+rw Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:57 devstack sudo[86007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.info Apr 15 10:08:57 devstack sudo[86007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:57 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904" returned: 1 in 0.528s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:57 devstack sudo[86007]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.info" returned: 0 in 0.448s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.530s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:57 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904 Apr 15 10:08:57 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.910s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1429959725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=652f30d1-699c-4629-96b3-c9d9b4102f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b955293cad0245dfa066074d7e8cbeaa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:56Z,use_quota=True,user_id='801de4a2f0054c20b68ae2f0153e2370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Creating volume 652f30d1-699c-4629-96b3-c9d9b4102f2f {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:57 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:57 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f 1073741824 Apr 15 10:08:57 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f8c5949a-c6df-4be5-955c-06032fe9f0da tempest-SnapshotsActionsTest-1372573577 None] Create snapshot completed successfully Apr 15 10:08:58 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-32b605d9-1620-469e-8cff-b3c2d2730904" returned: 0 in 0.512s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "cinder-quobyte-32b605d9-1620-469e-8cff-b3c2d2730904" released by "delete_volume" :: held 1.701s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG cinder.quota [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Created reservations ['e0d27406-b110-4065-84e1-4b7309aa4e81', '60a68e0b-442b-404b-a88d-4603c78e8024', '9c41e906-7d82-46e0-82b5-05c77d4edfb5', '0e7652b9-af4e-4c38-8451-507e168251c0'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:58 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:08:58 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:58 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f 1073741824" returned: 0 in 0.620s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:58 devstack sudo[86023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f Apr 15 10:08:58 devstack sudo[86023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:58 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.486s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:58 devstack cinder-volume[82600]: DEBUG cinder.manager [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:08:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Deleted volume successfully. Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-757bb8b3-9e55-4967-b6ba-e4ecdb0eb64f req-bb1ec30b-f812-44e9-bcb3-ef4daf84c7b3 tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "cinder-32b605d9-1620-469e-8cff-b3c2d2730904-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:59 devstack sudo[86023]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f" returned: 0 in 0.643s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] <== create_volume: return (1300ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.028s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:08:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-844692866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b4a110a-afc7-4660-b433-31906ff1a076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1043062ac21b4c8a87f6bdebcc5ee3d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:08:57Z,use_quota=True,user_id='3b4e14c8d50648fa92140f907d758fe3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Creating volume 3b4a110a-afc7-4660-b433-31906ff1a076 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:08:59 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b97201-ae4c-43ce-a28c-29b88824ae8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-652f30d1-699c-4629-96b3-c9d9b4102f2f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90607c6-e064-4066-89f3-22ec172421a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:08:59 devstack sudo[86061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 1073741824 Apr 15 10:08:59 devstack sudo[86061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:08:59 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Volume volume-652f30d1-699c-4629-96b3-c9d9b4102f2f (652f30d1-699c-4629-96b3-c9d9b4102f2f): created successfully Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90607c6-e064-4066-89f3-22ec172421a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Flow 'volume_create_manager' (d949a9ed-965c-4726-9586-ba0a7029579b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:08:59 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ec9c4d40-f201-4194-aa93-46238309265e tempest-VolumesServicesTestJSON-510075170 None] Created volume successfully. Apr 15 10:08:59 devstack sudo[86061]: pam_unix(sudo:session): session closed for user root Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 1073741824" returned: 0 in 0.606s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:08:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:08:59 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 Apr 15 10:08:59 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Acquiring lock "cinder-652f30d1-699c-4629-96b3-c9d9b4102f2f-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Lock "cinder-652f30d1-699c-4629-96b3-c9d9b4102f2f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:00 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076" returned: 0 in 0.497s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Acquiring lock "cinder-quobyte-652f30d1-699c-4629-96b3-c9d9b4102f2f" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.233s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ae40d49-6293-4890-b687-f522d4cb1aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b4a110a-afc7-4660-b433-31906ff1a076', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c982e9b9-9a41-4e68-bfe6-7b35d5adb57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Creating offline snapshot 19d0c151-f7be-47e4-8c73-8a6af509f880 of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Lock "cinder-quobyte-652f30d1-699c-4629-96b3-c9d9b4102f2f" acquired by "delete_volume" :: waited 0.069s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f85b39d-9e49-4f0c-8e32-07275bf88e5e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[deaee02c-750d-48ec-82fb-4b49a48537e7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:00 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Volume volume-3b4a110a-afc7-4660-b433-31906ff1a076 (3b4a110a-afc7-4660-b433-31906ff1a076): created successfully Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c982e9b9-9a41-4e68-bfe6-7b35d5adb57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Flow 'volume_create_manager' (50d2643a-c84e-4c06-b977-5101f6c00c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a76f7cfc-376a-4244-b519-6c8cff45f550 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Created volume successfully. Apr 15 10:09:00 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:00 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:00 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f Apr 15 10:09:00 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:00 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.560s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:01 devstack sudo[86087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 1G Apr 15 10:09:01 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:01 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f" returned: 0 in 0.602s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:01 devstack sudo[86090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f Apr 15 10:09:01 devstack sudo[86090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:01 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 1G" returned: 0 in 0.869s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:01 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 Apr 15 10:09:01 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:01 devstack sudo[86090]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-652f30d1-699c-4629-96b3-c9d9b4102f2f" returned: 0 in 0.871s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Lock "cinder-quobyte-652f30d1-699c-4629-96b3-c9d9b4102f2f" released by "delete_volume" :: held 1.509s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Created reservations ['0e4943e3-9392-4e18-9058-9164e4563a20', '897452f4-f13e-4c9a-afb8-b62e4c2dad77', '5145869f-08ab-41ee-a6ed-7d3e8cba7abf', '89c617f6-c48a-4488-a813-12f057cc36e6'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:02 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:02 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:02 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880" returned: 0 in 0.562s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:02 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 is being set with open permissions: ugo+rw Apr 15 10:09:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:02 devstack sudo[86135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 Apr 15 10:09:02 devstack sudo[86135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:02 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.533s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:02 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:02 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Deleted volume successfully. Apr 15 10:09:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf5720ea-b74a-4b86-a42d-7a8af880e38a tempest-VolumesServicesTestJSON-510075170 None] Lock "cinder-652f30d1-699c-4629-96b3-c9d9b4102f2f-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:03 devstack sudo[86135]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880" returned: 0 in 0.626s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.471s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Creating offline snapshot 2fbb3a84-ae69-4fd4-86b3-30c739eba7fa of volume 3b4a110a-afc7-4660-b433-31906ff1a076 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[14eface9-fec7-40ac-85c8-6a5e4a203fd6]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:03 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-951799fd-ff0c-4ea3-851f-0ba4c9a17a58 tempest-SnapshotsActionsTest-1372573577 None] Create snapshot completed successfully Apr 15 10:09:03 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 Apr 15 10:09:03 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-19d0c151-f7be-47e4-8c73-8a6af509f880-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-19d0c151-f7be-47e4-8c73-8a6af509f880-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-quobyte-19d0c151-f7be-47e4-8c73-8a6af509f880" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-19d0c151-f7be-47e4-8c73-8a6af509f880" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Deleting offline snapshot 19d0c151-f7be-47e4-8c73-8a6af509f880 of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] snapshot_file for this snap is: volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca3c10a-f5cf-4244-b64a-d14d8516cb14]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:03 devstack sudo[86141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 Apr 15 10:09:03 devstack sudo[86141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:03 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076" returned: 0 in 0.667s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:03 devstack sudo[86146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa 1G Apr 15 10:09:03 devstack sudo[86146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:04 devstack sudo[86141]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880" returned: 0 in 0.576s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[765687d9-2305-46c6-b7dc-856f835ba655]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:04 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:04 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:04 devstack sudo[86146]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa 1G" returned: 0 in 0.699s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b4a110a-afc7-4660-b433-31906ff1a076 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:04 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b4a110a-afc7-4660-b433-31906ff1a076 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa Apr 15 10:09:04 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:04 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.655s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:04 devstack sudo[86161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 Apr 15 10:09:04 devstack sudo[86161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:05 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b4a110a-afc7-4660-b433-31906ff1a076 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa" returned: 0 in 0.603s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:05 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa is being set with open permissions: ugo+rw Apr 15 10:09:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:05 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa Apr 15 10:09:05 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:05 devstack sudo[86161]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880" returned: 0 in 0.672s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:05 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880 Apr 15 10:09:05 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:05 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa" returned: 0 in 0.567s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:05 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.info Apr 15 10:09:05 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:06 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.19d0c151-f7be-47e4-8c73-8a6af509f880" returned: 0 in 0.557s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-19d0c151-f7be-47e4-8c73-8a6af509f880" released by "_delete_snapshot" :: held 2.530s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" released by "delete_snapshot" :: held 2.551s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Created reservations ['6b150935-c641-4b90-a085-f0b5182064f0', '53c23665-b3ce-49bc-aab4-0482e9bca4e7', '97ec9d63-5c1c-4337-a8f1-644505baf558', '088a4fde-e788-41ec-9f2c-c8ca3dd8750d'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:06 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Delete snapshot completed successfully. Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cb45cdba-8a82-45d6-aa9d-6560e1757cf1 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-19d0c151-f7be-47e4-8c73-8a6af509f880-delete_snapshot" released by "delete_snapshot" :: held 2.680s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:06 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.info" returned: 0 in 0.664s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:06 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.info is being set with open permissions: ugo+rw Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:06 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.info Apr 15 10:09:06 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:06 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.info" returned: 0 in 0.548s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.856s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:06 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8491b4f2-b168-42f4-b241-0ff6574f7195 tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Create snapshot completed successfully Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Creating offline snapshot 649e2268-1b49-496e-9448-16c58eb8d2e9 of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:07 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceb410c-50a4-4962-a0e0-d6dd824c9f55]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:07 devstack sudo[86182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:07 devstack sudo[86182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:07 devstack sudo[86182]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.658s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:07 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 1G Apr 15 10:09:07 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Flow 'volume_create_manager' (9f32b4fd-7780-41e3-a7c9-e0f8579bda47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928afda8-13c9-4524-bd20-493a4e4c606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (928afda8-13c9-4524-bd20-493a4e4c606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-597738231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60c18f0-0e36-4841-bc4b-491f00d3239a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f8e0b5569c4ee68f17839eac5116b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:08Z,use_quota=True,user_id='63954862c4944e71a5916ce92fdc8f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a35de02-5bf6-43cb-8548-7a63b95c5a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a35de02-5bf6-43cb-8548-7a63b95c5a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5f58f9-a900-445b-8e0d-2834d5aac9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.image.glance [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Creating Keystone auth plugin from conf {{(pid=82600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5f58f9-a900-445b-8e0d-2834d5aac9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c60c18f0-0e36-4841-bc4b-491f00d3239a', 'volume_name': 'volume-c60c18f0-0e36-4841-bc4b-491f00d3239a', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d3a708-f1d0-43e2-85e4-10e97c0914c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d3a708-f1d0-43e2-85e4-10e97c0914c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcaf4b9-03ed-4dfd-819b-5d4ede73d386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:08 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Volume c60c18f0-0e36-4841-bc4b-491f00d3239a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c60c18f0-0e36-4841-bc4b-491f00d3239a', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Trying to clone c60c18f0-0e36-4841-bc4b-491f00d3239a from image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]). {{(pid=82600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Acquiring lock "cinder-2fbb3a84-ae69-4fd4-86b3-30c739eba7fa-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-2fbb3a84-ae69-4fd4-86b3-30c739eba7fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Acquiring lock "cinder-quobyte-3b4a110a-afc7-4660-b433-31906ff1a076" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-quobyte-3b4a110a-afc7-4660-b433-31906ff1a076" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Acquiring lock "cinder-quobyte-2fbb3a84-ae69-4fd4-86b3-30c739eba7fa" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-quobyte-2fbb3a84-ae69-4fd4-86b3-30c739eba7fa" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Deleting offline snapshot 2fbb3a84-ae69-4fd4-86b3-30c739eba7fa of volume 3b4a110a-afc7-4660-b433-31906ff1a076 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] snapshot_file for this snap is: volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f758994e-b004-40b0-bc4c-de9ae59e90aa]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:08 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 1G" returned: 0 in 0.776s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:08 devstack sudo[86220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 Apr 15 10:09:08 devstack sudo[86220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:08 devstack sudo[86219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa Apr 15 10:09:08 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:09:08 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab16c4-8642-48eb-92d6-d54b5e46f2d8]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:08 devstack sudo[86225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD Apr 15 10:09:08 devstack sudo[86225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:09 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa" returned: 0 in 0.599s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b4a110a-afc7-4660-b433-31906ff1a076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:09 devstack sudo[86220]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9" returned: 0 in 0.611s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:09 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 is being set with open permissions: ugo+rw Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c95a10d-4f98-498c-8b69-3aabc7f92140]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:09 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 Apr 15 10:09:09 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:09 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 Apr 15 10:09:09 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:09 devstack sudo[86225]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Temporary image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 is fetched for user 63954862c4944e71a5916ce92fdc8f99. {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=145,cinder:INSERT=40,cinder:UPDATE=146,cinder:DELETE=6 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7281e5c-28d3-4996-8f82-512680e884d8]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:09 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD Apr 15 10:09:09 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:09 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9" returned: 0 in 0.562s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.674s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:09 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a4c708c1-67bf-4bcb-9335-a14c4d8b8ae0 tempest-SnapshotsActionsTest-1372573577 None] Create snapshot completed successfully Apr 15 10:09:09 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076" returned: 0 in 0.612s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:09 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa Apr 15 10:09:09 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:09 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD" returned: 0 in 0.568s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-597738231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c60c18f0-0e36-4841-bc4b-491f00d3239a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75f8e0b5569c4ee68f17839eac5116b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:08Z,use_quota=True,user_id='63954862c4944e71a5916ce92fdc8f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Creating volume c60c18f0-0e36-4841-bc4b-491f00d3239a {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:09 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:09:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:09 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a 1073741824 Apr 15 10:09:09 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:10 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2ec6634f-ba3e-4188-aa46-ff7f30390ceb tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Terminate volume connection completed successfully. Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2ec6634f-ba3e-4188-aa46-ff7f30390ceb tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Deleting attachment 558238df-8bde-470e-8d3d-096fe48b4217. {{(pid=82600) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-649e2268-1b49-496e-9448-16c58eb8d2e9-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-649e2268-1b49-496e-9448-16c58eb8d2e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:10 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:10 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-quobyte-649e2268-1b49-496e-9448-16c58eb8d2e9" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-649e2268-1b49-496e-9448-16c58eb8d2e9" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Deleting offline snapshot 649e2268-1b49-496e-9448-16c58eb8d2e9 of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] snapshot_file for this snap is: volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[010efcfc-8ff7-4031-b2d8-2f6b5f101457]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:10 devstack sudo[86260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 Apr 15 10:09:10 devstack sudo[86260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:10 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa" returned: 0 in 0.720s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:10 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa Apr 15 10:09:10 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:10 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a 1073741824" returned: 0 in 0.671s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:10 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a Apr 15 10:09:10 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "cinder-cff5df33-2017-4106-ba94-d1a2c81a5841-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "cinder-cff5df33-2017-4106-ba94-d1a2c81a5841-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "cinder-quobyte-cff5df33-2017-4106-ba94-d1a2c81a5841" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "cinder-quobyte-cff5df33-2017-4106-ba94-d1a2c81a5841" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[948685d0-80bc-4224-b6f7-29e852369847]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:10 devstack sudo[86272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 Apr 15 10:09:10 devstack sudo[86272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:10 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.760s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:11 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076.2fbb3a84-ae69-4fd4-86b3-30c739eba7fa" returned: 0 in 0.600s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:11 devstack sudo[86260]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9" returned: 0 in 0.692s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[595d069e-7240-45ac-9ffe-0b051c72d964]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-quobyte-2fbb3a84-ae69-4fd4-86b3-30c739eba7fa" released by "_delete_snapshot" :: held 2.657s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-quobyte-3b4a110a-afc7-4660-b433-31906ff1a076" released by "delete_snapshot" :: held 2.671s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Created reservations ['7ae8c629-46c7-4843-a6d5-ac80b91d054f', '1f33ea30-a2d2-4813-aa80-02cd9c58c454', 'ef182ffe-4ec8-4038-ab6a-ecdeb8d93e96', '2984874e-ed3a-4c24-9735-fd3f5bf2a2e4'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:11 devstack sudo[86276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:11 devstack sudo[86276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:11 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a" returned: 0 in 0.563s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] <== create_volume: return (1267ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.270s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:11 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Delete snapshot completed successfully. Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Attempting download of 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}])) to volume c60c18f0-0e36-4841-bc4b-491f00d3239a. {{(pid=82600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-791fa246-3219-4211-bf5a-6708e7133d5f tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-2fbb3a84-ae69-4fd4-86b3-30c739eba7fa-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e99b6d4-c757-4c05-8f00-76b54c600c1d]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_steuzhjn {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:11 devstack sudo[86278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_steuzhjn Apr 15 10:09:11 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:11 devstack sudo[86272]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841" returned: 0 in 0.657s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:11 devstack sudo[86284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841 Apr 15 10:09:11 devstack sudo[86284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Acquiring lock "cinder-3b4a110a-afc7-4660-b433-31906ff1a076-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-3b4a110a-afc7-4660-b433-31906ff1a076-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Acquiring lock "cinder-quobyte-3b4a110a-afc7-4660-b433-31906ff1a076" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-quobyte-3b4a110a-afc7-4660-b433-31906ff1a076" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb62c1f-a75e-44d8-91fa-db6d9e03b2d8]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:11 devstack sudo[86276]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.753s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:11 devstack sudo[86289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 Apr 15 10:09:11 devstack sudo[86289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:11 devstack sudo[86292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 Apr 15 10:09:11 devstack sudo[86292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:11 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_steuzhjn" returned: 0 in 0.653s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_steuzhjn {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:11 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_steuzhjn Apr 15 10:09:11 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:12 devstack sudo[86284]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cff5df33-2017-4106-ba94-d1a2c81a5841" returned: 0 in 0.537s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "cinder-quobyte-cff5df33-2017-4106-ba94-d1a2c81a5841" released by "delete_volume" :: held 1.220s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG cinder.quota [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Created reservations ['c875db0d-b967-462a-9d3e-9a60cabfcd50', '27379602-d3f5-43a4-bdc0-316874a184f7', '2ad5c806-bb3a-4481-9dfb-2897504b9880', '30a33a1b-c122-4c53-bab8-bb9c9789e042'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:12 devstack sudo[86299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:12 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:12 devstack sudo[86289]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076" returned: 0 in 0.623s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:12 devstack sudo[86308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076 Apr 15 10:09:12 devstack sudo[86308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:12 devstack sudo[86292]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9" returned: 0 in 0.599s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:12 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9 Apr 15 10:09:12 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:12 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_steuzhjn" returned: 1 in 0.611s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_steuzhjn' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d2ea99-3a03-4989-a001-61e981d507bf]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:12 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD Apr 15 10:09:12 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:12 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.580s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG cinder.manager [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:12 devstack cinder-volume[82600]: INFO cinder.volume.manager [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Deleted volume successfully. Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [req-f85b9fd2-fd71-4729-984f-3cc017758d89 req-2a8ecbe0-d524-4102-9680-c676fe91dc7f tempest-ServerBootFromVolumeStableRescueTest-492707192 None] Lock "cinder-cff5df33-2017-4106-ba94-d1a2c81a5841-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:12 devstack sudo[86308]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3b4a110a-afc7-4660-b433-31906ff1a076" returned: 0 in 0.600s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-quobyte-3b4a110a-afc7-4660-b433-31906ff1a076" released by "delete_volume" :: held 1.260s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:12 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.649e2268-1b49-496e-9448-16c58eb8d2e9" returned: 0 in 0.558s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-649e2268-1b49-496e-9448-16c58eb8d2e9" released by "_delete_snapshot" :: held 2.674s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" released by "delete_snapshot" :: held 2.694s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Created reservations ['de01a133-6145-481c-b038-7699d55a611b', 'c8f83f2c-12df-4b52-96ca-f6daad5f62c9', '24d795d6-48db-4073-839c-18d34543a775', '33ce7c2c-2328-47d1-8de3-51f36a971425'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Created reservations ['f780f55d-c7e6-4a07-86b3-5f05447fe360', '44e893e8-aaf5-4449-829e-dd2ae7b7a91a', '11ac697e-a175-4bc3-906e-08e0b01aa36c', '6316ac65-0c21-4263-bef5-956271c2d7f4'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:13 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD" returned: 0 in 0.621s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 was qcow2, converting to raw {{(pid=82600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:13 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:13 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:13 devstack sudo[86321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a Apr 15 10:09:13 devstack sudo[86321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Delete snapshot completed successfully. Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-99a3bfec-84c2-48da-924b-ee9473bb2bdb tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-649e2268-1b49-496e-9448-16c58eb8d2e9-delete_snapshot" released by "delete_snapshot" :: held 2.879s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:13 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.558s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Deleted volume successfully. Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-083ed708-9991-4e20-8822-44a5fed2600b tempest-VolumeSnapshotQuotasNegativeTestJSON-735864892 None] Lock "cinder-3b4a110a-afc7-4660-b433-31906ff1a076-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Creating offline snapshot b4b5236b-be03-46ee-8821-fd2981dc63c5 of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2f6afe-04d0-4cf2-b4db-cfb125e126bc]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:13 devstack sudo[86338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:13 devstack sudo[86338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:14 devstack sudo[86321]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a" returned: 0 in 1.194s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:14 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_xh83npkldevstack@QuobyteHD, size 112.00 MB, duration 1.19 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:09:14 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Converted 112.00 MB image at 93.72 MB/s Apr 15 10:09:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:14 devstack sudo[86344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a 1G Apr 15 10:09:14 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:14 devstack sudo[86338]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.671s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:14 devstack sudo[86346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 1G Apr 15 10:09:14 devstack sudo[86346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:14 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a 1G" returned: 0 in 0.580s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:14 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee57795-e3e8-4187-93bb-6aa3b0f079c4]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:15 devstack sudo[86354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a Apr 15 10:09:15 devstack sudo[86354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:15 devstack sudo[86346]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 1G" returned: 0 in 0.635s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:15 devstack sudo[86357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 Apr 15 10:09:15 devstack sudo[86357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:15 devstack sudo[86354]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a" returned: 0 in 0.765s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:15 devstack sudo[86357]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5" returned: 0 in 0.663s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:15 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 is being set with open permissions: ugo+rw Apr 15 10:09:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:15 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 Apr 15 10:09:15 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:15 devstack sudo[86390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a Apr 15 10:09:15 devstack sudo[86390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:16 devstack sudo[86390]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a" returned: 1 in 0.633s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Downloaded image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}])) to volume c60c18f0-0e36-4841-bc4b-491f00d3239a successfully. {{(pid=82600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Temporary image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 for user 63954862c4944e71a5916ce92fdc8f99 is deleted. {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Marking volume c60c18f0-0e36-4841-bc4b-491f00d3239a as bootable. {{(pid=82600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=158,cinder:UPDATE=185,cinder:INSERT=33,cinder:DELETE=14 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Copying metadata from image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 to c60c18f0-0e36-4841-bc4b-491f00d3239a. {{(pid=82600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Creating volume glance metadata for volume c60c18f0-0e36-4841-bc4b-491f00d3239a backed by image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:09:16 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcaf4b9-03ed-4dfd-819b-5d4ede73d386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c60c18f0-0e36-4841-bc4b-491f00d3239a', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75163e52-4bc3-4713-b935-e774d34d5e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5" returned: 0 in 0.716s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:16 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Volume volume-c60c18f0-0e36-4841-bc4b-491f00d3239a (c60c18f0-0e36-4841-bc4b-491f00d3239a): created successfully Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75163e52-4bc3-4713-b935-e774d34d5e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Flow 'volume_create_manager' (9f32b4fd-7780-41e3-a7c9-e0f8579bda47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:16 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-bcce4c9c-f854-4608-8dc0-1fec194fbb1c tempest-VolumesImageMetadata-928266092 None] Created volume successfully. Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:16 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c6aba15e-63b2-42ef-b569-2c1dbc897d43 tempest-SnapshotsActionsTest-1372573577 None] Create snapshot completed successfully Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-b4b5236b-be03-46ee-8821-fd2981dc63c5-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-b4b5236b-be03-46ee-8821-fd2981dc63c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-quobyte-b4b5236b-be03-46ee-8821-fd2981dc63c5" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-b4b5236b-be03-46ee-8821-fd2981dc63c5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:16 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Deleting offline snapshot b4b5236b-be03-46ee-8821-fd2981dc63c5 of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] snapshot_file for this snap is: volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9939de-77d6-4a51-b698-935baba6cefc]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:17 devstack sudo[86401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 Apr 15 10:09:17 devstack sudo[86401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Acquiring lock "cinder-c60c18f0-0e36-4841-bc4b-491f00d3239a-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Lock "cinder-c60c18f0-0e36-4841-bc4b-491f00d3239a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Acquiring lock "cinder-quobyte-c60c18f0-0e36-4841-bc4b-491f00d3239a" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Lock "cinder-quobyte-c60c18f0-0e36-4841-bc4b-491f00d3239a" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e7d425-4e6c-43ef-b4e9-5dfca9181aaa]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:17 devstack sudo[86404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a Apr 15 10:09:17 devstack sudo[86404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:17 devstack sudo[86401]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5" returned: 0 in 0.721s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4c2e3-29be-4c61-921b-c37f9b77845e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:17 devstack sudo[86409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:17 devstack sudo[86409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:17 devstack sudo[86404]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a" returned: 0 in 0.626s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:18 devstack sudo[86413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a Apr 15 10:09:18 devstack sudo[86413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:18 devstack sudo[86409]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.649s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:18 devstack sudo[86418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 Apr 15 10:09:18 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:18 devstack sudo[86413]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a" returned: 1 in 0.688s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:09:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:18 devstack sudo[86423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a Apr 15 10:09:18 devstack sudo[86423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:19 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5" returned: 0 in 0.586s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:19 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5 Apr 15 10:09:19 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:19 devstack sudo[86423]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c60c18f0-0e36-4841-bc4b-491f00d3239a" returned: 0 in 0.453s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Lock "cinder-quobyte-c60c18f0-0e36-4841-bc4b-491f00d3239a" released by "delete_volume" :: held 1.808s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Created reservations ['6991f007-bb09-4fae-af0f-20e23490c007', 'a082e321-1882-4505-a039-a344c0ca9129', '94f96286-fe38-40f2-898b-989e20ec0f9a', '6c18bf39-52b2-4ea8-a2a9-a9e214e39d3c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:19 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:19 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:19 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.b4b5236b-be03-46ee-8821-fd2981dc63c5" returned: 0 in 0.572s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-b4b5236b-be03-46ee-8821-fd2981dc63c5" released by "_delete_snapshot" :: held 2.613s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" released by "delete_snapshot" :: held 2.635s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Created reservations ['e8eb3fc9-8ad3-49f8-9249-e5dd79b8bd48', 'cb8c3eb1-5b3f-4c25-ac84-8d9e9a677f18', '0a2013e7-2b6d-42df-ab99-31098dc42b47', 'a2a8b80b-ec2e-416c-8f8b-da9a008a7b9a'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:19 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Delete snapshot completed successfully. Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7714514-b0a3-4b60-98c7-9f09ee5bec93 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-b4b5236b-be03-46ee-8821-fd2981dc63c5-delete_snapshot" released by "delete_snapshot" :: held 2.771s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:19 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.652s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:19 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Deleted volume successfully. Apr 15 10:09:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97104502-2302-4974-9580-9026cf1b4b0d tempest-VolumesImageMetadata-928266092 None] Lock "cinder-c60c18f0-0e36-4841-bc4b-491f00d3239a-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Creating offline snapshot 400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:20 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40b932a-b30c-4ec4-b03d-fa32171e2d24]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:20 devstack sudo[86435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:20 devstack sudo[86435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:21 devstack sudo[86435]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.832s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:21 devstack sudo[86440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 1G Apr 15 10:09:21 devstack sudo[86440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Flow 'volume_create_manager' (1e1b9760-3823-4d7b-ab0c-216c3fce1a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d240faae-e59d-431c-ab33-aa0a76896f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d240faae-e59d-431c-ab33-aa0a76896f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-789011171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695960c24b574811b44c6edba5ddbaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:22Z,use_quota=True,user_id='1019a2af52a0464bbc2370b496557dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3c7446-a4e7-4ec6-94e5-57721c95b98c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee3c7446-a4e7-4ec6-94e5-57721c95b98c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cf3785-f362-4cb8-9143-e2a1c4b74e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cf3785-f362-4cb8-9143-e2a1c4b74e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8', 'volume_name': 'volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c456c28c-737b-4aae-9c6d-1e7e2a7ca6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c456c28c-737b-4aae-9c6d-1e7e2a7ca6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b786a58-6874-47be-8a9f-050a71b17915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:21 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Volume a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8', 'volume_size': 1} Apr 15 10:09:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:22 devstack sudo[86440]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 1G" returned: 0 in 0.798s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:22 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 Apr 15 10:09:22 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:22 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2" returned: 0 in 0.627s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:22 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 is being set with open permissions: ugo+rw Apr 15 10:09:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:22 devstack sudo[86452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 Apr 15 10:09:22 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:23 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2" returned: 0 in 0.568s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.926s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.445s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-789011171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='695960c24b574811b44c6edba5ddbaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:22Z,use_quota=True,user_id='1019a2af52a0464bbc2370b496557dfa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Creating volume a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:23 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:23 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-937913f1-7a52-49f2-842a-aaa25ed7dd7f tempest-SnapshotsActionsTest-1372573577 None] Create snapshot completed successfully Apr 15 10:09:23 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 1073741824 Apr 15 10:09:23 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-400b0ffa-50b3-480c-b2d3-aa54d41fd2d2-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-400b0ffa-50b3-480c-b2d3-aa54d41fd2d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Acquiring lock "cinder-quobyte-400b0ffa-50b3-480c-b2d3-aa54d41fd2d2" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-400b0ffa-50b3-480c-b2d3-aa54d41fd2d2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Deleting offline snapshot 400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] snapshot_file for this snap is: volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e45739f-09c6-453a-b021-cd017057f0b5]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:23 devstack sudo[86457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 Apr 15 10:09:23 devstack sudo[86457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:24 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 1073741824" returned: 0 in 0.791s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:24 devstack sudo[86462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 Apr 15 10:09:24 devstack sudo[86462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:24 devstack sudo[86457]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2" returned: 0 in 0.763s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e032eaf1-9ce7-44e1-9097-cace9936f50e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:24 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:24 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:24 devstack sudo[86462]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" returned: 0 in 0.784s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b786a58-6874-47be-8a9f-050a71b17915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6df49cd-47fc-4725-b4f2-aa727324bd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:24 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Volume volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 (a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8): created successfully Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6df49cd-47fc-4725-b4f2-aa727324bd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Flow 'volume_create_manager' (1e1b9760-3823-4d7b-ab0c-216c3fce1a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:24 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cb5e1414-a1ea-4f66-8a5e-d513f5131884 tempest-SnapshotMetadataTestJSON-210364999 None] Created volume successfully. Apr 15 10:09:25 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.667s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:25 devstack sudo[86473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 Apr 15 10:09:25 devstack sudo[86473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:25 devstack sudo[86473]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2" returned: 0 in 0.695s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:25 devstack sudo[86479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2 Apr 15 10:09:25 devstack sudo[86479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Creating offline snapshot a677abe3-0b68-461e-97d4-dde8112e27a3 of volume a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d465f2e1-9a1b-454a-9458-5d6c99b27b39]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:26 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 Apr 15 10:09:26 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:26 devstack sudo[86479]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.400b0ffa-50b3-480c-b2d3-aa54d41fd2d2" returned: 0 in 0.685s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-400b0ffa-50b3-480c-b2d3-aa54d41fd2d2" released by "_delete_snapshot" :: held 2.879s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" released by "delete_snapshot" :: held 2.903s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Created reservations ['39300ada-3132-40a1-8d72-ba9dddbcadb5', '41a72241-fd11-48b4-b85e-99a83f7088ac', '02b2b83f-3105-464c-8777-ad975024254e', '87a47126-a11c-45de-8d97-05a6b520ee0e'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:26 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Delete snapshot completed successfully. Apr 15 10:09:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ae2187a9-69a4-4eb4-95d1-7813630dafe3 tempest-SnapshotsActionsTest-1892417658 None] Lock "cinder-400b0ffa-50b3-480c-b2d3-aa54d41fd2d2-delete_snapshot" released by "delete_snapshot" :: held 3.053s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:27 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" returned: 0 in 0.800s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:27 devstack sudo[86488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 1G Apr 15 10:09:27 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "cinder-06243f92-f16b-4ca6-a635-092dc24734ba-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-06243f92-f16b-4ca6-a635-092dc24734ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "cinder-quobyte-06243f92-f16b-4ca6-a635-092dc24734ba" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-quobyte-06243f92-f16b-4ca6-a635-092dc24734ba" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Deleting offline snapshot 06243f92-f16b-4ca6-a635-092dc24734ba of volume 3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] snapshot_file for this snap is: volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27b16ee-9bf0-4357-b7dc-a89a7ad489a4]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:27 devstack sudo[86490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:27 devstack sudo[86490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:27 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 1G" returned: 0 in 0.622s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:27 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 Apr 15 10:09:27 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:28 devstack sudo[86490]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.849s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3be12087-b47f-424c-bcbe-3758c5245fbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:28 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f875923-0006-4962-81a7-9abc721f4e03]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:28 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3" returned: 0 in 0.739s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:28 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 is being set with open permissions: ugo+rw Apr 15 10:09:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:28 devstack sudo[86503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb Apr 15 10:09:28 devstack sudo[86503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:28 devstack sudo[86504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 Apr 15 10:09:28 devstack sudo[86504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:29 devstack sudo[86504]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3" returned: 0 in 0.629s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:29 devstack sudo[86503]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb" returned: 0 in 0.749s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:29 devstack sudo[86511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:29 devstack sudo[86511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:29 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.info Apr 15 10:09:29 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:29 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.info" returned: 0 in 0.556s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:29 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.info is being set with open permissions: ugo+rw Apr 15 10:09:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:29 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.info Apr 15 10:09:29 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:29 devstack sudo[86511]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.734s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:29 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba Apr 15 10:09:29 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:30 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.info" returned: 0 in 0.692s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.161s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-9513f8d3-9034-4b39-a876-378d57018b26 tempest-SnapshotMetadataTestJSON-210364999 None] Create snapshot completed successfully Apr 15 10:09:30 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb.06243f92-f16b-4ca6-a635-092dc24734ba" returned: 0 in 0.625s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-quobyte-06243f92-f16b-4ca6-a635-092dc24734ba" released by "_delete_snapshot" :: held 3.030s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" released by "delete_snapshot" :: held 3.051s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:30 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Created reservations ['88fb3de8-4b0e-4d84-9e14-c87f3a56d651', '8decd10a-358a-4e5d-8359-505e5f52cd75', '13fac030-3fa9-42e7-8840-0f9123bd9ea5', 'aad34a6e-127c-4b6c-b92e-bbe48dade040'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Delete snapshot completed successfully. Apr 15 10:09:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-61485c32-0553-4ebd-b048-2ce333865152 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-06243f92-f16b-4ca6-a635-092dc24734ba-delete_snapshot" released by "delete_snapshot" :: held 3.185s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:31 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1934d3cf-d64e-4afb-9c0b-0bdd3aca1393 tempest-GroupSnapshotsTest-1483548353 None] Group tempest-GroupSnapshotsTest-Group-1886847145: creating Apr 15 10:09:31 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1934d3cf-d64e-4afb-9c0b-0bdd3aca1393 tempest-GroupSnapshotsTest-1483548353 None] Group tempest-GroupSnapshotsTest-Group-1886847145: created successfully Apr 15 10:09:31 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1934d3cf-d64e-4afb-9c0b-0bdd3aca1393 tempest-GroupSnapshotsTest-1483548353 None] Create group completed successfully. Apr 15 10:09:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "cinder-3be12087-b47f-424c-bcbe-3758c5245fbb-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-3be12087-b47f-424c-bcbe-3758c5245fbb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:31 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dbc09f-b2c6-446f-a6cc-1d0cd3195e90]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:31 devstack sudo[86528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb Apr 15 10:09:31 devstack sudo[86528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Acquiring lock "cinder-a677abe3-0b68-461e-97d4-dde8112e27a3-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-a677abe3-0b68-461e-97d4-dde8112e27a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Acquiring lock "cinder-quobyte-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-quobyte-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Acquiring lock "cinder-quobyte-a677abe3-0b68-461e-97d4-dde8112e27a3" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-quobyte-a677abe3-0b68-461e-97d4-dde8112e27a3" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Deleting offline snapshot a677abe3-0b68-461e-97d4-dde8112e27a3 of volume a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] snapshot_file for this snap is: volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f5d816-9195-478c-a268-7772d51b518e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:32 devstack sudo[86530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 Apr 15 10:09:32 devstack sudo[86530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:32 devstack sudo[86528]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb" returned: 0 in 0.618s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:32 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb Apr 15 10:09:32 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:32 devstack sudo[86530]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3" returned: 0 in 0.712s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e739f6cd-5d13-4280-9860-8a10bf54b17b]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:32 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 Apr 15 10:09:32 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Flow 'volume_create_manager' (b0de793e-e8c8-4cb3-b815-7c2fd8092da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033bb414-1175-480d-8604-f52cea19877a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (033bb414-1175-480d-8604-f52cea19877a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1483823564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2126363c-9c43-47b5-81d9-e020afc54def,host='devstack@QuobyteHD#QuobyteHD',id=8ce26679-cc2c-4db5-a465-be5da733ccee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce87d9b7fe545fd908a1d49cc73277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:33Z,use_quota=True,user_id='90f3a6681f344e14bbe032a9eea5369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05febd73-b6e8-488f-9844-648defff61a1),volume_type_id=05febd73-b6e8-488f-9844-648defff61a1)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d209232-bd88-411a-915a-73e927fab145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d209232-bd88-411a-915a-73e927fab145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bc3c7c-224e-4f4d-9ac7-c12db3912678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bc3c7c-224e-4f4d-9ac7-c12db3912678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce26679-cc2c-4db5-a465-be5da733ccee', 'volume_name': 'volume-8ce26679-cc2c-4db5-a465-be5da733ccee', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf0e2cb-1370-4022-bbf3-17d8f0851d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbf0e2cb-1370-4022-bbf3-17d8f0851d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107fee53-f3ec-424d-a691-916b54bc98bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:33 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Volume 8ce26679-cc2c-4db5-a465-be5da733ccee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce26679-cc2c-4db5-a465-be5da733ccee', 'volume_size': 1} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2126363c-9c43-47b5-81d9-e020afc54def,created_at=2026-04-15T08:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1483823564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2126363c-9c43-47b5-81d9-e020afc54def,host='devstack@QuobyteHD#QuobyteHD',id=8ce26679-cc2c-4db5-a465-be5da733ccee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce87d9b7fe545fd908a1d49cc73277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:33Z,use_quota=True,user_id='90f3a6681f344e14bbe032a9eea5369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05febd73-b6e8-488f-9844-648defff61a1),volume_type_id=05febd73-b6e8-488f-9844-648defff61a1)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Creating volume 8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:33 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:33 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3be12087-b47f-424c-bcbe-3758c5245fbb" returned: 0 in 0.716s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-quobyte-3be12087-b47f-424c-bcbe-3758c5245fbb" released by "delete_volume" :: held 1.396s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:33 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee 1073741824 Apr 15 10:09:33 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Created reservations ['faa322fb-c977-4c9c-8c07-f00498858cda', 'c1bed07a-50b1-41f5-b97e-f130335474b3', '6c3e168d-e9e5-4e88-a369-13f216f75c31', 'ed53f264-4f74-4e66-83f4-096e5c87e7bb'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:33 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:33 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:33 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" returned: 0 in 0.829s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:33 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 Apr 15 10:09:33 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:33 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.638s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:33 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Deleted volume successfully. Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-eaee6f85-019d-4a59-93e0-5b93500bcec2 tempest-SnapshotsActionsTest-1372573577 None] Lock "cinder-3be12087-b47f-424c-bcbe-3758c5245fbb-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:33 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee 1073741824" returned: 0 in 0.859s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:34 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee Apr 15 10:09:34 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:34 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3" returned: 0 in 0.727s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:34 devstack sudo[86561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3 Apr 15 10:09:34 devstack sudo[86561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:34 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee" returned: 0 in 0.732s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107fee53-f3ec-424d-a691-916b54bc98bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce26679-cc2c-4db5-a465-be5da733ccee', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675efda9-42ac-45ac-a8f4-f7cceb73a6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:34 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Volume volume-8ce26679-cc2c-4db5-a465-be5da733ccee (8ce26679-cc2c-4db5-a465-be5da733ccee): created successfully Apr 15 10:09:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (675efda9-42ac-45ac-a8f4-f7cceb73a6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Flow 'volume_create_manager' (b0de793e-e8c8-4cb3-b815-7c2fd8092da7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:34 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0a593f8d-3758-412d-9df2-37e9f542dfe0 tempest-GroupSnapshotsTest-1483548353 None] Created volume successfully. Apr 15 10:09:35 devstack sudo[86561]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8.a677abe3-0b68-461e-97d4-dde8112e27a3" returned: 0 in 0.604s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-quobyte-a677abe3-0b68-461e-97d4-dde8112e27a3" released by "_delete_snapshot" :: held 2.949s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-quobyte-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" released by "delete_snapshot" :: held 2.968s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Created reservations ['ea39c996-35b9-4da9-9c73-b9b6ec61bb5c', 'bc6456d3-2421-4143-a520-fa4bbf58c0dd', '5acf9652-97a5-4a65-8dc4-95d8ad9d8ac6', '726d23f5-3bce-4196-a1f5-4063b2468c28'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:35 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Delete snapshot completed successfully. Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cd64879c-8143-4e8b-b3e0-4ce21ddbd541 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-a677abe3-0b68-461e-97d4-dde8112e27a3-delete_snapshot" released by "delete_snapshot" :: held 3.091s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Acquiring lock "cinder-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Acquiring lock "cinder-quobyte-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-quobyte-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" acquired by "delete_volume" :: waited 0.019s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb738c38-c13a-48b7-b218-2a94ae34ab24]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:35 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] GroupSnapshot d734e112-efed-40f8-a491-0b2424f391f2: creating. Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Group snapshot d734e112-efed-40f8-a491-0b2424f391f2: creating. {{(pid=82600) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:09:35 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 Apr 15 10:09:35 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Creating offline snapshot e25946d3-2193-4755-b44f-aee83f2d6f5d of volume 8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df2826d-71cd-47fc-ab9c-5528d0962ea0]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:35 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee Apr 15 10:09:35 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:36 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee" returned: 0 in 0.735s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:36 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" returned: 0 in 0.910s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:36 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d 1G Apr 15 10:09:36 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:36 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8 Apr 15 10:09:36 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:37 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d 1G" returned: 0 in 0.740s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ce26679-cc2c-4db5-a465-be5da733ccee -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:37 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" returned: 0 in 0.740s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-quobyte-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8" released by "delete_volume" :: held 1.722s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:37 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ce26679-cc2c-4db5-a465-be5da733ccee -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d Apr 15 10:09:37 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Created reservations ['ee729749-9530-4ed3-80aa-1a3f074935a5', 'a9d5fd16-8971-4456-b55b-d21834bf0c90', 'a65f8181-9b8f-4fb0-975a-0f246ef94daf', '16470777-d0bd-46e4-8d49-fd7d522b9322'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:37 devstack sudo[86585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:37 devstack sudo[86585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:37 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ce26679-cc2c-4db5-a465-be5da733ccee -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d" returned: 0 in 0.690s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:37 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:09:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:37 devstack sudo[86590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d Apr 15 10:09:37 devstack sudo[86590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:38 devstack sudo[86585]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.987s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:38 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:38 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Deleted volume successfully. Apr 15 10:09:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5652b83c-0d8a-400b-9976-5cb1c87ed914 tempest-SnapshotMetadataTestJSON-210364999 None] Lock "cinder-a09c6fbf-85a0-4da9-a14e-0cd6f8a287c8-delete_volume" released by "delete_volume" :: held 2.997s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:38 devstack sudo[86590]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d" returned: 0 in 0.883s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:38 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.info Apr 15 10:09:38 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Flow 'volume_create_manager' (ecbb7ebb-43af-42cd-be11-935fcb624050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fdfd97-24e5-4fe5-9225-0c7df74c90c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96fdfd97-24e5-4fe5-9225-0c7df74c90c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1137093186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ed4932-e942-4c9b-856c-b1c93d122030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60033314e50141c59735a72b3302dfb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:39Z,use_quota=True,user_id='db6f33bc4c4b42838600a39870ca3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2ad3b7-ff5c-4ef5-ba7d-7b4ca37a0826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2ad3b7-ff5c-4ef5-ba7d-7b4ca37a0826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb9da88-f2f1-4d8e-bc81-5fb76c60c748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb9da88-f2f1-4d8e-bc81-5fb76c60c748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81ed4932-e942-4c9b-856c-b1c93d122030', 'volume_name': 'volume-81ed4932-e942-4c9b-856c-b1c93d122030', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b095c59-baa1-43a8-9118-237d1d7ca42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b095c59-baa1-43a8-9118-237d1d7ca42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd7b4f5-2304-400b-b884-8655ef664e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:39 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Volume 81ed4932-e942-4c9b-856c-b1c93d122030: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81ed4932-e942-4c9b-856c-b1c93d122030', 'volume_size': 1} Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:39 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.info" returned: 0 in 0.646s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:39 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:09:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:39 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.info Apr 15 10:09:39 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:40 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.info" returned: 0 in 0.650s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.421s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.838s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1137093186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81ed4932-e942-4c9b-856c-b1c93d122030,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60033314e50141c59735a72b3302dfb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:39Z,use_quota=True,user_id='db6f33bc4c4b42838600a39870ca3ec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Creating volume 81ed4932-e942-4c9b-856c-b1c93d122030 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:40 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:40 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030 1073741824 Apr 15 10:09:40 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:40 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-421bf1a6-95ad-4d4d-b837-3d383d25d151 tempest-GroupSnapshotsTest-1483548353 None] group_snapshot d734e112-efed-40f8-a491-0b2424f391f2: created successfully Apr 15 10:09:40 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030 1073741824" returned: 0 in 0.682s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:40 devstack sudo[86608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030 Apr 15 10:09:40 devstack sudo[86608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:41 devstack sudo[86608]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030" returned: 0 in 0.604s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] <== create_volume: return (1323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd7b4f5-2304-400b-b884-8655ef664e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81ed4932-e942-4c9b-856c-b1c93d122030', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99c4a0d-5017-4ceb-ac17-43016995247d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:41 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Volume volume-81ed4932-e942-4c9b-856c-b1c93d122030 (81ed4932-e942-4c9b-856c-b1c93d122030): created successfully Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e99c4a0d-5017-4ceb-ac17-43016995247d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Flow 'volume_create_manager' (ecbb7ebb-43af-42cd-be11-935fcb624050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:41 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-60fe080b-79fb-4231-af03-538edb541a7f tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Created volume successfully. Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Flow 'volume_create_manager' (1dcb5708-7f2a-493a-8352-9acd27aa3807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20405f46-b2a0-47fc-8437-5bb55057c935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20405f46-b2a0-47fc-8437-5bb55057c935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1908686616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b7ca4f-d7e1-441e-ac2c-84c664c930b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bf4e3c321f4bc0a26c96cf297490fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:42Z,use_quota=True,user_id='6dbc3456f43b44b98a50889820320eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8303d08-a3d9-4643-b798-e992c5cc9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8303d08-a3d9-4643-b798-e992c5cc9650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c9256c-d311-40df-977e-27549588710a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0c9256c-d311-40df-977e-27549588710a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b7ca4f-d7e1-441e-ac2c-84c664c930b3', 'volume_name': 'volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e100d47-8d09-4ceb-8547-b409dd4445c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e100d47-8d09-4ceb-8547-b409dd4445c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1aa7400-9b4e-4078-9a6b-aa4cbb6ab59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:41 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Volume d4b7ca4f-d7e1-441e-ac2c-84c664c930b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3', 'volume_size': 1} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1908686616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b7ca4f-d7e1-441e-ac2c-84c664c930b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01bf4e3c321f4bc0a26c96cf297490fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:42Z,use_quota=True,user_id='6dbc3456f43b44b98a50889820320eec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Creating volume d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:41 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:09:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:41 devstack sudo[86613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 1073741824 Apr 15 10:09:41 devstack sudo[86613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:42 devstack sudo[86613]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 1073741824" returned: 0 in 0.587s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:42 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 Apr 15 10:09:42 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:43 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3" returned: 0 in 0.507s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.056s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-e25946d3-2193-4755-b44f-aee83f2d6f5d-83dd7792-1c05-4d02-9961-9c86b3ad70a3" by "_create_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1aa7400-9b4e-4078-9a6b-aa4cbb6ab59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74cf3e7-7af6-469a-9334-619a34a29e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Acquiring lock "cinder-81ed4932-e942-4c9b-856c-b1c93d122030-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-e25946d3-2193-4755-b44f-aee83f2d6f5d-83dd7792-1c05-4d02-9961-9c86b3ad70a3" acquired by "_create_volume_from_snapshot" :: waited 0.047s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Creating volume 83dd7792-1c05-4d02-9961-9c86b3ad70a3 from snapshot e25946d3-2193-4755-b44f-aee83f2d6f5d {{(pid=82600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-83dd7792-1c05-4d02-9961-9c86b3ad70a3" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:43 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Volume volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 (d4b7ca4f-d7e1-441e-ac2c-84c664c930b3): created successfully Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c74cf3e7-7af6-469a-9334-619a34a29e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Flow 'volume_create_manager' (1dcb5708-7f2a-493a-8352-9acd27aa3807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "cinder-81ed4932-e942-4c9b-856c-b1c93d122030-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:43 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-809b7661-1565-4e43-a99e-8c885c979c85 tempest-AbsoluteLimitsTests-750245892 None] Created volume successfully. Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-83dd7792-1c05-4d02-9961-9c86b3ad70a3" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] snapshot: e25946d3-2193-4755-b44f-aee83f2d6f5d, volume: 83dd7792-1c05-4d02-9961-9c86b3ad70a3, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b094c84-c6c6-4c8e-b1b6-9ea48e1c69f7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Acquiring lock "cinder-quobyte-81ed4932-e942-4c9b-856c-b1c93d122030" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "cinder-quobyte-81ed4932-e942-4c9b-856c-b1c93d122030" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b88628-c6ed-492f-93fb-da81eaaa5b60]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:43 devstack sudo[86622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d Apr 15 10:09:43 devstack sudo[86622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:43 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030 Apr 15 10:09:43 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:43 devstack sudo[86622]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d" returned: 0 in 0.566s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ce26679-cc2c-4db5-a465-be5da733ccee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[79526643-b49d-4718-8006-6990f2253ae3]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:43 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030" returned: 0 in 0.566s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:43 devstack sudo[86633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030 Apr 15 10:09:43 devstack sudo[86633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:43 devstack sudo[86632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee Apr 15 10:09:43 devstack sudo[86632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Acquiring lock "cinder-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Lock "cinder-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Acquiring lock "cinder-quobyte-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Lock "cinder-quobyte-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef20214-8014-44b7-819b-2782dd35104e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:44 devstack sudo[86636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 Apr 15 10:09:44 devstack sudo[86636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:44 devstack sudo[86633]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-81ed4932-e942-4c9b-856c-b1c93d122030" returned: 0 in 0.541s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "cinder-quobyte-81ed4932-e942-4c9b-856c-b1c93d122030" released by "delete_volume" :: held 1.158s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:44 devstack sudo[86632]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee" returned: 0 in 0.646s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Created reservations ['a21af9f1-6240-4db7-93b8-4da3b30a03c0', 'ab007ccc-b88d-44ca-a0f5-f0138df5e38b', '5ac4de9b-cae4-4202-9d5d-cebdcf84a96d', '077d5db3-259e-40ab-a38f-668d31e5fdcc'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:44 devstack sudo[86642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 Apr 15 10:09:44 devstack sudo[86642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:44 devstack sudo[86644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:44 devstack sudo[86644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:44 devstack sudo[86636]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3" returned: 0 in 0.685s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:44 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3 Apr 15 10:09:44 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:45 devstack sudo[86644]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.852s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:45 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Deleted volume successfully. Apr 15 10:09:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ddac8baf-6696-4b16-b055-c94c3f97efec tempest-VolumeQuotasNegativeTestJSON-2074742530 None] Lock "cinder-81ed4932-e942-4c9b-856c-b1c93d122030-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:46 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3" returned: 0 in 1.792s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Lock "cinder-quobyte-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3" released by "delete_volume" :: held 2.525s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:46 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Created reservations ['77a5d8de-bf94-429e-b340-0940e3e93dfd', '577b3306-baf7-40e3-b82a-3748bbeb4ea8', '2fc2ff1b-26e5-4ebe-ac7e-7995dd9a2bd5', '9ecbe3d3-92dd-413e-86f1-021df076642e'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:47 devstack sudo[86642]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3" returned: 0 in 2.661s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[65828ab3-878b-484d-b804-57c0f680057d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:47 devstack sudo[86668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:47 devstack sudo[86668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:47 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee Apr 15 10:09:47 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:47 devstack sudo[86668]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.709s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:47 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Deleted volume successfully. Apr 15 10:09:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-18116796-f90f-42bb-b838-b1b7a3e01282 tempest-AbsoluteLimitsTests-750245892 None] Lock "cinder-d4b7ca4f-d7e1-441e-ac2c-84c664c930b3-delete_volume" released by "delete_volume" :: held 3.721s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:48 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee" returned: 0 in 1.143s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:48 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee, size 1024.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:09:48 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Converted 1024.00 MB image at 384.45 MB/s Apr 15 10:09:48 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:09:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:48 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 Apr 15 10:09:48 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:48 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3" returned: 0 in 0.579s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-83dd7792-1c05-4d02-9961-9c86b3ad70a3" released by "_copy_volume_from_snapshot" :: held 5.684s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-e25946d3-2193-4755-b44f-aee83f2d6f5d-83dd7792-1c05-4d02-9961-9c86b3ad70a3" released by "_create_volume_from_snapshot" :: held 5.744s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.793s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:48 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b39b8dd5-c8da-4bfa-b6eb-f5d7180b2f09 tempest-GroupSnapshotsTest-1483548353 None] Create group from source-snapshot-d734e112-efed-40f8-a491-0b2424f391f2 completed successfully. Apr 15 10:09:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-83dd7792-1c05-4d02-9961-9c86b3ad70a3" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-83dd7792-1c05-4d02-9961-9c86b3ad70a3" acquired by "delete_volume" :: waited 0.022s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:49 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e45b8b-e7da-4de3-9f89-6c5250567d1a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:49 devstack sudo[86692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 Apr 15 10:09:49 devstack sudo[86692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:50 devstack sudo[86692]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3" returned: 0 in 0.655s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:50 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3 Apr 15 10:09:50 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:50 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-83dd7792-1c05-4d02-9961-9c86b3ad70a3" returned: 0 in 0.642s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-83dd7792-1c05-4d02-9961-9c86b3ad70a3" released by "delete_volume" :: held 1.325s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:50 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['f51f39d6-88ec-4861-a8fa-0a7d67efcdf7'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:50 devstack cinder-volume[82600]: WARNING cinder.quota [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-276811795 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-276811795, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:50 devstack cinder-volume[82600]: WARNING cinder.quota [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-276811795 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-276811795, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:50 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['84a89fba-1784-429b-8f6f-e63cf85c65c0', '685225eb-1a0f-45e2-af4d-5cf9bddc3a76', 'ae1ace44-34ce-4994-b28e-f3c6beae337e', '9946c20f-0d80-41f8-bc76-570d82de2544'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:51 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:51 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:51 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.647s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-24a720a7-629e-4e39-a50d-d1c79a20d926 tempest-GroupSnapshotsTest-1483548353 None] Delete group completed successfully. Apr 15 10:09:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] group_snapshot d734e112-efed-40f8-a491-0b2424f391f2: deleting Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] group_snapshot d734e112-efed-40f8-a491-0b2424f391f2: deleting {{(pid=82600) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-8ce26679-cc2c-4db5-a465-be5da733ccee" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-8ce26679-cc2c-4db5-a465-be5da733ccee" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-e25946d3-2193-4755-b44f-aee83f2d6f5d" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-e25946d3-2193-4755-b44f-aee83f2d6f5d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Deleting offline snapshot e25946d3-2193-4755-b44f-aee83f2d6f5d of volume 8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] snapshot_file for this snap is: volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7f4e2b-abb3-4c87-82b3-7ab13e5a2f52]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:51 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d Apr 15 10:09:51 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Flow 'volume_create_manager' (269ddd59-1d4c-473f-bebb-1d1f46be6e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0158c03-a0d7-4b3c-811d-533372752734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0158c03-a0d7-4b3c-811d-533372752734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1041638576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde77526-4d43-40f2-9d5a-528af127ec9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e8604b505e45d7ac7e58e11e592def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:52Z,use_quota=True,user_id='e11fd59a8be74baba9969a3ca0b1642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cad5e740-40bf-497b-a8ee-72792f4fa47d),volume_type_id=cad5e740-40bf-497b-a8ee-72792f4fa47d)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c368bf24-fed6-4be0-9a3a-19cabaaa294c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c368bf24-fed6-4be0-9a3a-19cabaaa294c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0255bc-0425-4dac-9db3-5aae09825e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c0255bc-0425-4dac-9db3-5aae09825e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fde77526-4d43-40f2-9d5a-528af127ec9e', 'volume_name': 'volume-fde77526-4d43-40f2-9d5a-528af127ec9e', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619d9564-3d16-4a39-b2c4-f2fcf2c726db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619d9564-3d16-4a39-b2c4-f2fcf2c726db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d27ea68-98a5-4291-a15c-c715f1fc36ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Volume fde77526-4d43-40f2-9d5a-528af127ec9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fde77526-4d43-40f2-9d5a-528af127ec9e', 'volume_size': 1} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1041638576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fde77526-4d43-40f2-9d5a-528af127ec9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6e8604b505e45d7ac7e58e11e592def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:52Z,use_quota=True,user_id='e11fd59a8be74baba9969a3ca0b1642e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cad5e740-40bf-497b-a8ee-72792f4fa47d),volume_type_id=cad5e740-40bf-497b-a8ee-72792f4fa47d)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Creating volume fde77526-4d43-40f2-9d5a-528af127ec9e {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:52 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:52 devstack sudo[86718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e 1073741824 Apr 15 10:09:52 devstack sudo[86718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:52 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d" returned: 0 in 0.617s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ce26679-cc2c-4db5-a465-be5da733ccee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b1559c-be6a-4d7e-b8b5-22086f61bfe0]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:52 devstack sudo[86720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee Apr 15 10:09:52 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Flow 'volume_create_manager' (04352200-cd0b-4dec-aec8-61011bcce880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe515038-dd88-43eb-8f0d-793153818bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe515038-dd88-43eb-8f0d-793153818bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-835490985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d94bf2-7b7d-4330-99a3-8204291d63cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2ca187c08a4b9abb15e8c4f318ec00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:53Z,use_quota=True,user_id='f4caccacda1e4344ab1dd016ba58bfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e41dac-a64c-4e3e-9881-afd6deabf3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20e41dac-a64c-4e3e-9881-afd6deabf3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde5456d-a3f3-4b9b-a21d-0fb0cc678684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde5456d-a3f3-4b9b-a21d-0fb0cc678684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4d94bf2-7b7d-4330-99a3-8204291d63cc', 'volume_name': 'volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e495d9-a4b7-4531-8d01-0f631a5f1394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24e495d9-a4b7-4531-8d01-0f631a5f1394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febb34a7-28c0-4ec6-ac65-367788e17a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:52 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Volume b4d94bf2-7b7d-4330-99a3-8204291d63cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc', 'volume_size': 1} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:52 devstack sudo[86718]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e 1073741824" returned: 0 in 0.633s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:52 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e Apr 15 10:09:52 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:53 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee" returned: 0 in 0.605s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:53 devstack sudo[86730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d Apr 15 10:09:53 devstack sudo[86730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:53 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e" returned: 0 in 0.483s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.534s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-835490985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4d94bf2-7b7d-4330-99a3-8204291d63cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2ca187c08a4b9abb15e8c4f318ec00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:53Z,use_quota=True,user_id='f4caccacda1e4344ab1dd016ba58bfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Creating volume b4d94bf2-7b7d-4330-99a3-8204291d63cc {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:53 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:53 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc 1073741824 Apr 15 10:09:53 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d27ea68-98a5-4291-a15c-c715f1fc36ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fde77526-4d43-40f2-9d5a-528af127ec9e', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f417642-08c0-41bc-82e9-7ae836156a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:53 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Volume volume-fde77526-4d43-40f2-9d5a-528af127ec9e (fde77526-4d43-40f2-9d5a-528af127ec9e): created successfully Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f417642-08c0-41bc-82e9-7ae836156a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Flow 'volume_create_manager' (269ddd59-1d4c-473f-bebb-1d1f46be6e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:53 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-453480f6-ff92-474e-b141-a4a4e9fcf4f8 tempest-VolumeTypesAccessTest-536145895 None] Created volume successfully. Apr 15 10:09:53 devstack sudo[86730]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d" returned: 0 in 0.498s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:53 devstack sudo[86738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d Apr 15 10:09:53 devstack sudo[86738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:54 devstack sudo[86738]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee.e25946d3-2193-4755-b44f-aee83f2d6f5d" returned: 0 in 0.704s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-e25946d3-2193-4755-b44f-aee83f2d6f5d" released by "_delete_snapshot" :: held 2.504s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-8ce26679-cc2c-4db5-a465-be5da733ccee" released by "delete_snapshot" :: held 2.530s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:54 devstack cinder-volume[82600]: WARNING cinder.quota [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-276811795 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-276811795, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['77019749-9504-4a14-812c-dc6afefe7357', '8216889d-0bbb-449a-89b0-a9fbd3170b5f', '7837651a-cd30-48b6-aca7-c84ca66646ee', 'cc3d9552-9565-4a68-ad64-97f06871b9fc'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:54 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc 1073741824" returned: 0 in 0.992s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Acquiring lock "cinder-fde77526-4d43-40f2-9d5a-528af127ec9e-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:54 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ccce9b7b-9200-4e8c-b855-0c4394d8ac1d tempest-GroupSnapshotsTest-1483548353 None] group_snapshot d734e112-efed-40f8-a491-0b2424f391f2: deleted successfully Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Lock "cinder-fde77526-4d43-40f2-9d5a-528af127ec9e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:54 devstack sudo[86773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc Apr 15 10:09:54 devstack sudo[86773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Acquiring lock "cinder-quobyte-fde77526-4d43-40f2-9d5a-528af127ec9e" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Lock "cinder-quobyte-fde77526-4d43-40f2-9d5a-528af127ec9e" acquired by "delete_volume" :: waited 0.023s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[89019515-10fb-4efe-a651-d77c3d440e18]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:54 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e Apr 15 10:09:54 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:55 devstack sudo[86773]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc" returned: 0 in 0.634s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (febb34a7-28c0-4ec6-ac65-367788e17a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b886c5-5b03-47de-826e-e79ebd18fcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:55 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Volume volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc (b4d94bf2-7b7d-4330-99a3-8204291d63cc): created successfully Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b886c5-5b03-47de-826e-e79ebd18fcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Flow 'volume_create_manager' (04352200-cd0b-4dec-aec8-61011bcce880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:55 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-72a47f7b-d9c3-4ba8-bdd0-5d219172c06d tempest-VolumesTransfersV357Test-399792977 None] Created volume successfully. Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-8ce26679-cc2c-4db5-a465-be5da733ccee" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-8ce26679-cc2c-4db5-a465-be5da733ccee" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef3fa12-3648-4250-9aa7-638d6b85b2f8]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:55 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee Apr 15 10:09:55 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:55 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e" returned: 0 in 0.854s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:55 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e Apr 15 10:09:55 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:55 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fde77526-4d43-40f2-9d5a-528af127ec9e" returned: 0 in 0.458s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Lock "cinder-quobyte-fde77526-4d43-40f2-9d5a-528af127ec9e" released by "delete_volume" :: held 1.355s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:55 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee" returned: 0 in 0.594s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:55 devstack cinder-volume[82600]: WARNING cinder.quota [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1321349656 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1321349656, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:55 devstack cinder-volume[82600]: WARNING cinder.quota [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1321349656 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1321349656, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:09:56 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee Apr 15 10:09:56 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Created reservations ['21ed7e85-3c04-4b48-8254-c4bb692a0a24', 'cdcb115b-57cd-436a-9163-e06975e03d38', '049f9dee-eae7-48e6-bfbe-53bdf0bf9311', '1456d760-535b-45fb-9edd-3218e77532fc'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:56 devstack sudo[86791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:56 devstack sudo[86791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (79220215-eeb0-4b84-826c-aa7bb8b89df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c04f59-031b-4bfe-a427-165240fe8582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80c04f59-031b-4bfe-a427-165240fe8582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-509734562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fa5698-07e0-43b9-91c0-ffcde47e0090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:57Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d09dfcc-2107-4dd8-ae05-7c2871d2fdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d09dfcc-2107-4dd8-ae05-7c2871d2fdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db52f349-d5b2-49b4-8a53-70c068c7681f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db52f349-d5b2-49b4-8a53-70c068c7681f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fa5698-07e0-43b9-91c0-ffcde47e0090', 'volume_name': 'volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7e10a5-9c92-46d3-a561-ea52b0db5748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d7e10a5-9c92-46d3-a561-ea52b0db5748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea3fcb4-25ae-4637-82f3-6f63fc8a82b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:56 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Volume c1fa5698-07e0-43b9-91c0-ffcde47e0090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090', 'volume_size': 1} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-509734562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fa5698-07e0-43b9-91c0-ffcde47e0090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:09:57Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Creating volume c1fa5698-07e0-43b9-91c0-ffcde47e0090 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:09:56 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:56 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 1073741824 Apr 15 10:09:56 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:56 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ce26679-cc2c-4db5-a465-be5da733ccee" returned: 0 in 0.905s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-8ce26679-cc2c-4db5-a465-be5da733ccee" released by "delete_volume" :: held 1.555s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:56 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b3e25c95-be0b-4db6-917a-937afb073d64 tempest-VolumesTransfersV357Test-1995338701 None] Transfer volume completed successfully. Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['b3581d7e-91f0-4f27-b1b1-847faa4afd5f'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:56 devstack cinder-volume[82600]: WARNING cinder.db.sqlalchemy.api [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-276811795'] Apr 15 10:09:56 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['b47febeb-228e-4cdf-bbae-a0277d48af2b', '8b184bce-e94a-4a81-8016-ce01022c27b6', 'd8c36dcd-292d-40cc-86e1-62b8b47c30f8', '5f26118f-3deb-4bc0-b65a-85a2e33a5351'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:09:57 devstack sudo[86791]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.954s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Deleted volume successfully. Apr 15 10:09:57 devstack sudo[86797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:09:57 devstack sudo[86797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-85f86e2c-5aed-4607-b0fb-887aba500f28 tempest-VolumeTypesAccessTest-536145895 None] Lock "cinder-fde77526-4d43-40f2-9d5a-528af127ec9e-delete_volume" released by "delete_volume" :: held 2.608s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:57 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 1073741824" returned: 0 in 0.848s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:57 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 Apr 15 10:09:57 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:57 devstack sudo[86797]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.753s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:57 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:09:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-9a26c73c-6d7b-4b13-8219-602dcf8cc381 tempest-GroupSnapshotsTest-1483548353 None] Delete group completed successfully. Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Acquiring lock "cinder-b4d94bf2-7b7d-4330-99a3-8204291d63cc-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Lock "cinder-b4d94bf2-7b7d-4330-99a3-8204291d63cc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Acquiring lock "cinder-quobyte-b4d94bf2-7b7d-4330-99a3-8204291d63cc" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c8e1c043-4ce0-4562-a698-b132e95441af tempest-GroupSnapshotsTest-1483548353 None] Group tempest-GroupSnapshotsTest-Group-746284070: creating Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Lock "cinder-quobyte-b4d94bf2-7b7d-4330-99a3-8204291d63cc" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c8e1c043-4ce0-4562-a698-b132e95441af tempest-GroupSnapshotsTest-1483548353 None] Group tempest-GroupSnapshotsTest-Group-746284070: created successfully Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ad1bed-3ea3-4c3f-8873-4105dfd4f3c9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c8e1c043-4ce0-4562-a698-b132e95441af tempest-GroupSnapshotsTest-1483548353 None] Create group completed successfully. Apr 15 10:09:58 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc Apr 15 10:09:58 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:09:58 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090" returned: 0 in 0.882s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea3fcb4-25ae-4637-82f3-6f63fc8a82b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cb4c1e-2ec0-40ce-8628-88e858c8a5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:09:58 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Volume volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 (c1fa5698-07e0-43b9-91c0-ffcde47e0090): created successfully Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cb4c1e-2ec0-40ce-8628-88e858c8a5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (79220215-eeb0-4b84-826c-aa7bb8b89df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:09:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c79663fa-b194-47cf-9fff-df49e9548de7 tempest-VolumesActionsTest-1899341244 None] Created volume successfully. Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e52710a3-e834-4748-ae82-d042b29edf94 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090" by "attach_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e52710a3-e834-4748-ae82-d042b29edf94 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090" acquired by "attach_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:09:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e52710a3-e834-4748-ae82-d042b29edf94 tempest-VolumesActionsTest-1899341244 None] Attaching volume c1fa5698-07e0-43b9-91c0-ffcde47e0090 to instance 78ead2f9-6bf3-429a-82ff-912533038c20 at mountpoint /dev/vdb on host None. Apr 15 10:09:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e52710a3-e834-4748-ae82-d042b29edf94 tempest-VolumesActionsTest-1899341244 None] Attach volume completed successfully. Apr 15 10:09:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e52710a3-e834-4748-ae82-d042b29edf94 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090" released by "attach_volume" :: held 0.132s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:09:59 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 15 10:09:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc" returned: 0 in 0.726s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:09:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:09:59 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc Apr 15 10:09:59 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:00 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Flow 'volume_create_manager' (fef5267a-0db1-4dcc-9ca8-9085499c9e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04281c9-837c-411e-b7d5-691bb75fc493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4d94bf2-7b7d-4330-99a3-8204291d63cc" returned: 0 in 1.213s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-46cdcc8b-7c98-44b0-a1b6-fbe7bdc9f8e1 tempest-VolumesActionsTest-950756866 None] Terminate volume connection completed successfully. Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d04281c9-837c-411e-b7d5-691bb75fc493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1081283268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbd8d5e4-bb40-4c7b-89aa-dd8fe0faf3d8,host='devstack@QuobyteHD#QuobyteHD',id=ed7218de-78ba-4119-a093-be491c43337f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce87d9b7fe545fd908a1d49cc73277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:00Z,use_quota=True,user_id='90f3a6681f344e14bbe032a9eea5369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(561c1dff-30be-444f-bd7c-789c8f8b9811),volume_type_id=561c1dff-30be-444f-bd7c-789c8f8b9811)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae4554d-07ae-4179-8a9e-4fc425bcd927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae4554d-07ae-4179-8a9e-4fc425bcd927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b05de7-4ffa-4d08-9a2a-9d110265657d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45b05de7-4ffa-4d08-9a2a-9d110265657d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7218de-78ba-4119-a093-be491c43337f', 'volume_name': 'volume-ed7218de-78ba-4119-a093-be491c43337f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d48ad4f-f870-4b89-aa02-3b8228175f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d48ad4f-f870-4b89-aa02-3b8228175f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52428d3-9e92-40cf-90bc-2194d82db14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:00 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Volume ed7218de-78ba-4119-a093-be491c43337f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7218de-78ba-4119-a093-be491c43337f', 'volume_size': 1} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbd8d5e4-bb40-4c7b-89aa-dd8fe0faf3d8,created_at=2026-04-15T08:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1081283268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbd8d5e4-bb40-4c7b-89aa-dd8fe0faf3d8,host='devstack@QuobyteHD#QuobyteHD',id=ed7218de-78ba-4119-a093-be491c43337f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce87d9b7fe545fd908a1d49cc73277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:00Z,use_quota=True,user_id='90f3a6681f344e14bbe032a9eea5369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(561c1dff-30be-444f-bd7c-789c8f8b9811),volume_type_id=561c1dff-30be-444f-bd7c-789c8f8b9811)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Creating volume ed7218de-78ba-4119-a093-be491c43337f {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:00 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Lock "cinder-quobyte-b4d94bf2-7b7d-4330-99a3-8204291d63cc" released by "delete_volume" :: held 2.073s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:00 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f 1073741824 Apr 15 10:10:00 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Created reservations ['8a5dbdfa-8742-4b1f-ae68-076ce495fea3', 'fc623d91-6135-424c-9b75-d3c486dc9502', 'bd448c07-3937-4254-96aa-6ffccb7bcce2', '8d5b9810-9c5d-4368-ad5e-ee05c00af217'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:00 devstack sudo[86857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:00 devstack sudo[86857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46cdcc8b-7c98-44b0-a1b6-fbe7bdc9f8e1 tempest-VolumesActionsTest-950756866 None] Acquiring lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090-detach_volume" by "detach_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46cdcc8b-7c98-44b0-a1b6-fbe7bdc9f8e1 tempest-VolumesActionsTest-950756866 None] Lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-46cdcc8b-7c98-44b0-a1b6-fbe7bdc9f8e1 tempest-VolumesActionsTest-950756866 None] Detaching volume c1fa5698-07e0-43b9-91c0-ffcde47e0090 from instance 78ead2f9-6bf3-429a-82ff-912533038c20. Apr 15 10:10:01 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-46cdcc8b-7c98-44b0-a1b6-fbe7bdc9f8e1 tempest-VolumesActionsTest-950756866 None] Detach volume completed successfully. Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46cdcc8b-7c98-44b0-a1b6-fbe7bdc9f8e1 tempest-VolumesActionsTest-950756866 None] Lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090-detach_volume" released by "detach_volume" :: held 0.193s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Flow 'volume_create_manager' (fc920634-030f-40d3-902c-ca5c497c9e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d773b33e-9313-4d0b-9599-a2139e1d5d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack sudo[86857]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.766s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d773b33e-9313-4d0b-9599-a2139e1d5d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1041419936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f651f9db-94e0-473d-b82c-9fa3ec6155fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2ca187c08a4b9abb15e8c4f318ec00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:01Z,use_quota=True,user_id='f4caccacda1e4344ab1dd016ba58bfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd0f457-4e4e-45de-a850-168e3e4f3640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fd0f457-4e4e-45de-a850-168e3e4f3640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a6ef22-3aee-432a-8f11-8c4c5dbccd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a6ef22-3aee-432a-8f11-8c4c5dbccd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f651f9db-94e0-473d-b82c-9fa3ec6155fa', 'volume_name': 'volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083a587f-17ac-4241-b6c1-2149abdd62d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (083a587f-17ac-4241-b6c1-2149abdd62d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8de319-d376-4a01-919d-b918217f726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:01 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Volume f651f9db-94e0-473d-b82c-9fa3ec6155fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa', 'volume_size': 1} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:01 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Deleted volume successfully. Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-daec8d0e-a7e6-44be-a21f-2fd454131557 tempest-VolumesTransfersV357Test-1744436848 None] Lock "cinder-b4d94bf2-7b7d-4330-99a3-8204291d63cc-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8dadb704-17ff-43fb-9394-4eedeec0635c tempest-VolumesActionsTest-1899341244 None] Acquiring lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090-detach_volume" by "detach_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:01 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f 1073741824" returned: 0 in 1.197s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8dadb704-17ff-43fb-9394-4eedeec0635c tempest-VolumesActionsTest-1899341244 None] Lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:01 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8dadb704-17ff-43fb-9394-4eedeec0635c tempest-VolumesActionsTest-1899341244 None] Volume detach called, but volume not attached. Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8dadb704-17ff-43fb-9394-4eedeec0635c tempest-VolumesActionsTest-1899341244 None] Lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090-detach_volume" released by "detach_volume" :: held 0.030s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:01 devstack sudo[86864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f Apr 15 10:10:01 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:02 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f" returned: 0 in 0.625s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1041419936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f651f9db-94e0-473d-b82c-9fa3ec6155fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2ca187c08a4b9abb15e8c4f318ec00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:01Z,use_quota=True,user_id='f4caccacda1e4344ab1dd016ba58bfc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Creating volume f651f9db-94e0-473d-b82c-9fa3ec6155fa {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:02 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52428d3-9e92-40cf-90bc-2194d82db14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7218de-78ba-4119-a093-be491c43337f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:02 devstack sudo[86867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa 1073741824 Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41725150-5218-4823-ab52-890aed65094d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:02 devstack sudo[86867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:02 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Volume volume-ed7218de-78ba-4119-a093-be491c43337f (ed7218de-78ba-4119-a093-be491c43337f): created successfully Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41725150-5218-4823-ab52-890aed65094d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Flow 'volume_create_manager' (fef5267a-0db1-4dcc-9ca8-9085499c9e7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:02 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-604e7135-cf7c-4bfc-b15d-ec3ee39edbe1 tempest-GroupSnapshotsTest-1483548353 None] Created volume successfully. Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "cinder-quobyte-c1fa5698-07e0-43b9-91c0-ffcde47e0090" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-quobyte-c1fa5698-07e0-43b9-91c0-ffcde47e0090" acquired by "delete_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[456cd41b-c7cd-4f43-85a2-d634c0e9aad2]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:02 devstack sudo[86869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 Apr 15 10:10:02 devstack sudo[86869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Flow 'volume_create_manager' (1ccaf490-4126-4d0e-8872-c9ca66fb3b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb25cc3-14eb-4397-b0ed-77cb2603aa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bb25cc3-14eb-4397-b0ed-77cb2603aa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524147113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbd8d5e4-bb40-4c7b-89aa-dd8fe0faf3d8,host='devstack@QuobyteHD#QuobyteHD',id=19ffc9af-c44f-4a0a-b1f4-78e5b529b453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce87d9b7fe545fd908a1d49cc73277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:03Z,use_quota=True,user_id='90f3a6681f344e14bbe032a9eea5369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(561c1dff-30be-444f-bd7c-789c8f8b9811),volume_type_id=561c1dff-30be-444f-bd7c-789c8f8b9811)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bd2b76-f2b9-45ef-94eb-dd7382a63d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77bd2b76-f2b9-45ef-94eb-dd7382a63d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bcd846-614a-4b91-95e7-fd39b7c27f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9bcd846-614a-4b91-95e7-fd39b7c27f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19ffc9af-c44f-4a0a-b1f4-78e5b529b453', 'volume_name': 'volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5219318d-91f9-4f65-afb1-c97dc4c83f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5219318d-91f9-4f65-afb1-c97dc4c83f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e597aa-3b2f-4250-88b9-1cd22efa2903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:03 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Volume 19ffc9af-c44f-4a0a-b1f4-78e5b529b453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453', 'volume_size': 1} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:03 devstack sudo[86867]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa 1073741824" returned: 0 in 1.054s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:03 devstack sudo[86877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa Apr 15 10:10:03 devstack sudo[86877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:03 devstack sudo[86869]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090" returned: 0 in 0.992s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:03 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090 Apr 15 10:10:03 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:04 devstack sudo[86877]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa" returned: 0 in 0.674s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:04 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.832s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dbd8d5e4-bb40-4c7b-89aa-dd8fe0faf3d8,created_at=2026-04-15T08:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-524147113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dbd8d5e4-bb40-4c7b-89aa-dd8fe0faf3d8,host='devstack@QuobyteHD#QuobyteHD',id=19ffc9af-c44f-4a0a-b1f4-78e5b529b453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce87d9b7fe545fd908a1d49cc73277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:03Z,use_quota=True,user_id='90f3a6681f344e14bbe032a9eea5369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(561c1dff-30be-444f-bd7c-789c8f8b9811),volume_type_id=561c1dff-30be-444f-bd7c-789c8f8b9811)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Creating volume 19ffc9af-c44f-4a0a-b1f4-78e5b529b453 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:04 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c1fa5698-07e0-43b9-91c0-ffcde47e0090" returned: 0 in 0.581s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-quobyte-c1fa5698-07e0-43b9-91c0-ffcde47e0090" released by "delete_volume" :: held 1.633s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f8de319-d376-4a01-919d-b918217f726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d084f1-2142-4139-b7da-cd9172513f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:04 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 1073741824 Apr 15 10:10:04 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:04 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Volume volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa (f651f9db-94e0-473d-b82c-9fa3ec6155fa): created successfully Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d084f1-2142-4139-b7da-cd9172513f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Flow 'volume_create_manager' (fc920634-030f-40d3-902c-ca5c497c9e04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ed9d8fd0-69ac-46be-a9c4-f2ac5dc2eb95 tempest-VolumesTransfersV357Test-399792977 None] Created volume successfully. Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Created reservations ['d89b93d7-03c1-45e9-b818-6e6ea357a2f9', '8848828b-9332-49a5-b2dc-0fee8e6102e8', '9622f30e-5cf8-4db4-8caa-2e2e5f39eb01', '2744121d-c7e4-4021-8e4d-2813f998d6c3'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:04 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:04 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Acquiring lock "cinder-f651f9db-94e0-473d-b82c-9fa3ec6155fa-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Lock "cinder-f651f9db-94e0-473d-b82c-9fa3ec6155fa-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Acquiring lock "cinder-quobyte-f651f9db-94e0-473d-b82c-9fa3ec6155fa" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Lock "cinder-quobyte-f651f9db-94e0-473d-b82c-9fa3ec6155fa" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa347121-87ef-4405-b18e-e6a47744c65a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:05 devstack sudo[86891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa Apr 15 10:10:05 devstack sudo[86891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:05 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 1073741824" returned: 0 in 1.121s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:05 devstack sudo[86894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 Apr 15 10:10:05 devstack sudo[86894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:05 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.018s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:05 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Deleted volume successfully. Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01383b2f-9b55-4a85-aa85-a7a92f7a8e12 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-c1fa5698-07e0-43b9-91c0-ffcde47e0090-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:05 devstack sudo[86891]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa" returned: 0 in 0.896s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:05 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa Apr 15 10:10:05 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:05 devstack sudo[86894]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" returned: 0 in 0.685s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31e597aa-3b2f-4250-88b9-1cd22efa2903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09a05d2-09f5-4241-a153-6eb3a168befb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:05 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Volume volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 (19ffc9af-c44f-4a0a-b1f4-78e5b529b453): created successfully Apr 15 10:10:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09a05d2-09f5-4241-a153-6eb3a168befb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Flow 'volume_create_manager' (1ccaf490-4126-4d0e-8872-c9ca66fb3b49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:06 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-66296666-2c0c-4f5a-8114-4769a9bd4705 tempest-GroupSnapshotsTest-1483548353 None] Created volume successfully. Apr 15 10:10:06 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f651f9db-94e0-473d-b82c-9fa3ec6155fa" returned: 0 in 0.761s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Lock "cinder-quobyte-f651f9db-94e0-473d-b82c-9fa3ec6155fa" released by "delete_volume" :: held 1.701s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:06 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-512a959e-6d4b-4057-8178-340c1af4d3f1 tempest-GroupSnapshotsTest-1483548353 None] Update group completed successfully. Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Created reservations ['d677c219-af9f-4ff8-8bd9-8743a6ab2866', '3a356017-c0db-4d39-aff4-6223086565e3', '1c1cd704-4d3b-46e0-ae23-2555fd22dcda', '8415b534-7d76-444b-8b9f-77554cb2fa6d'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:06 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:06 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:07 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.570s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:07 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:07 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Deleted volume successfully. Apr 15 10:10:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46160825-54ff-4aa1-badb-07fc32560b35 tempest-VolumesTransfersV357Test-1744436848 None] Lock "cinder-f651f9db-94e0-473d-b82c-9fa3ec6155fa-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:07 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-deb53b99-2258-4b31-9e0b-0bfe0142053e tempest-GroupSnapshotsTest-1483548353 None] Update group completed successfully. Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Flow 'volume_create_manager' (5e0db0c2-2a25-49a6-9074-b6875a95afd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0fdbb8-f9d5-4a66-b1aa-d71ca281802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef0fdbb8-f9d5-4a66-b1aa-d71ca281802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1500725972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3b1b52-f05a-4a5d-ba69-c79c5d907d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a3002db4956482bb2f62025a1301ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:09Z,use_quota=True,user_id='e4b8923029334d079f09b6056d3de3b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f23b668-989c-4f40-83de-63faacc07064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f23b668-989c-4f40-83de-63faacc07064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc317523-d97e-4a1d-ab47-020e157f715c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc317523-d97e-4a1d-ab47-020e157f715c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c3b1b52-f05a-4a5d-ba69-c79c5d907d54', 'volume_name': 'volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f159adeb-4b4c-4aa1-a5de-806752ca6dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f159adeb-4b4c-4aa1-a5de-806752ca6dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc80a0e-1c13-4ab3-bd21-8b1e5e40b76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:08 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Volume 6c3b1b52-f05a-4a5d-ba69-c79c5d907d54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54', 'volume_size': 1} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1500725972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3b1b52-f05a-4a5d-ba69-c79c5d907d54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a3002db4956482bb2f62025a1301ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:09Z,use_quota=True,user_id='e4b8923029334d079f09b6056d3de3b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Creating volume 6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:08 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:08 devstack sudo[86936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 1073741824 Apr 15 10:10:08 devstack sudo[86936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:09 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-aa0e2866-3ddb-4b26-afba-58f25807c998 tempest-GroupSnapshotsTest-1483548353 None] Update group completed successfully. Apr 15 10:10:09 devstack sudo[86936]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 1073741824" returned: 0 in 0.678s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:09 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=178,cinder:DELETE=10,cinder:UPDATE=191,cinder:INSERT=64 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:10:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:09 devstack sudo[86941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 Apr 15 10:10:09 devstack sudo[86941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:10 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-3546143f-f5b7-45dd-8255-c3dae0d58a72 tempest-GroupSnapshotsTest-1483548353 None] Update group completed successfully. Apr 15 10:10:10 devstack sudo[86941]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" returned: 0 in 0.586s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cc80a0e-1c13-4ab3-bd21-8b1e5e40b76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40bd701b-f94d-4fc6-8160-16688d393e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:10 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Volume volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 (6c3b1b52-f05a-4a5d-ba69-c79c5d907d54): created successfully Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40bd701b-f94d-4fc6-8160-16688d393e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Flow 'volume_create_manager' (5e0db0c2-2a25-49a6-9074-b6875a95afd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:10 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2fcb5161-bc82-4c91-971b-122f83f738c7 tempest-VolumesDeleteCascade-437312007 None] Created volume successfully. Apr 15 10:10:10 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:10 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:10 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.531s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Creating offline snapshot de207ef8-0f58-4790-b67d-3eaf20fe17ab of volume 6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[469fa645-39f7-424b-b88b-62ebbc89093c]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:11 devstack sudo[86947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 Apr 15 10:10:11 devstack sudo[86947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:11 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] GroupSnapshot 4c13c64e-ff4b-4692-9db0-44f8b689942c: creating. Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Group snapshot 4c13c64e-ff4b-4692-9db0-44f8b689942c: creating. {{(pid=82600) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:11 devstack sudo[86947]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Flow 'volume_create_manager' (597bbf12-bb03-4523-81da-02fb1d268fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b73895-6ab0-43ec-a1be-a4bd49a07de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" returned: 0 in 0.675s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0b73895-6ab0-43ec-a1be-a4bd49a07de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24720ef6-5544-4ce6-9aff-067428553004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330a38ebf5e945acacf13fe2fcd6545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:12Z,use_quota=True,user_id='cf64a9c0995c47f9b1cad0f5bae6fbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:11 devstack sudo[86953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab 1G Apr 15 10:10:11 devstack sudo[86953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec4e632-1231-410c-b46b-9ccc8b1dc465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aec4e632-1231-410c-b46b-9ccc8b1dc465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ff5ae5-1cdd-4333-a935-18a6007bff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ff5ae5-1cdd-4333-a935-18a6007bff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24720ef6-5544-4ce6-9aff-067428553004', 'volume_name': 'volume-24720ef6-5544-4ce6-9aff-067428553004', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c88eb42-cfbc-4a37-a1cb-aa69b93ac551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c88eb42-cfbc-4a37-a1cb-aa69b93ac551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c205e192-a53b-4206-b49d-90e2d73b55b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:11 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Volume 24720ef6-5544-4ce6-9aff-067428553004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24720ef6-5544-4ce6-9aff-067428553004', 'volume_size': 1} Apr 15 10:10:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:12 devstack sudo[86953]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab 1G" returned: 0 in 0.574s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:12 devstack sudo[86958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab Apr 15 10:10:12 devstack sudo[86958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (98fbcb22-f32b-40aa-b2bb-acaf3860fc3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61039e1-172d-49cc-9fd4-894ca79e7b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61039e1-172d-49cc-9fd4-894ca79e7b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419275531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6a534a-4114-4841-9168-9aef70467fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:12Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8501cc67-3f51-456e-9d19-c5759a44a1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8501cc67-3f51-456e-9d19-c5759a44a1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b153543-f57a-4e0c-8116-4bba8bea8579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b153543-f57a-4e0c-8116-4bba8bea8579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c6a534a-4114-4841-9168-9aef70467fdb', 'volume_name': 'volume-0c6a534a-4114-4841-9168-9aef70467fdb', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553e626a-0dc8-4ee3-ab05-125ecc2747c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (553e626a-0dc8-4ee3-ab05-125ecc2747c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9fb4bf-e6ae-4c27-9119-44f6035a2fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:12 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Volume 0c6a534a-4114-4841-9168-9aef70467fdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c6a534a-4114-4841-9168-9aef70467fdb', 'volume_size': 1} Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:12 devstack sudo[86958]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab" returned: 0 in 0.520s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:12 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab is being set with open permissions: ugo+rw Apr 15 10:10:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:12 devstack sudo[86963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab Apr 15 10:10:12 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:13 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab" returned: 0 in 0.501s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:13 devstack sudo[86966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.info Apr 15 10:10:13 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:13 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.info" returned: 0 in 0.451s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:13 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.info is being set with open permissions: ugo+rw Apr 15 10:10:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:13 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.info Apr 15 10:10:13 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:14 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.info" returned: 0 in 0.438s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.226s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.737s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Creating offline snapshot 57981586-ddcf-4217-b638-d5de5217279d of volume 19ffc9af-c44f-4a0a-b1f4-78e5b529b453 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:14 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d2ab3856-d8aa-4f66-afd6-62550ee60e54 tempest-VolumesDeleteCascade-437312007 None] Create snapshot completed successfully Apr 15 10:10:14 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9074187-792e-4da0-923f-eea10806d09d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:14 devstack sudo[86972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 Apr 15 10:10:14 devstack sudo[86972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:14 devstack sudo[86972]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" returned: 0 in 0.474s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:14 devstack sudo[86977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d 1G Apr 15 10:10:14 devstack sudo[86977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:15 devstack sudo[86977]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d 1G" returned: 0 in 0.515s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:15 devstack sudo[86982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d Apr 15 10:10:15 devstack sudo[86982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:15 devstack sudo[86982]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d" returned: 0 in 0.488s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:15 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:15 devstack sudo[86987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d Apr 15 10:10:15 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:16 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d" returned: 0 in 0.448s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:16 devstack sudo[86990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.info Apr 15 10:10:16 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:16 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.info" returned: 0 in 0.456s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:16 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:16 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.info Apr 15 10:10:16 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.info" returned: 0 in 0.455s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.941s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Creating offline snapshot d6301e5f-b300-4a33-a0f8-36a8e1a175dc of volume ed7218de-78ba-4119-a093-be491c43337f {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:17 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74a78da-60c2-4957-b805-aff81c509634]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f Apr 15 10:10:17 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:17 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f" returned: 0 in 0.498s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:17 devstack sudo[87002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc 1G Apr 15 10:10:17 devstack sudo[87002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:18 devstack sudo[87002]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc 1G" returned: 0 in 0.493s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7218de-78ba-4119-a093-be491c43337f -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:18 devstack sudo[87007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7218de-78ba-4119-a093-be491c43337f -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc Apr 15 10:10:18 devstack sudo[87007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:18 devstack sudo[87007]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7218de-78ba-4119-a093-be491c43337f -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc" returned: 0 in 0.451s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:18 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:18 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc Apr 15 10:10:18 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:19 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc" returned: 0 in 0.421s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:19 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:UPDATE=180,cinder:SELECT=166,cinder:DELETE=15,cinder:INSERT=39 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:10:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:19 devstack sudo[87015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.info Apr 15 10:10:19 devstack sudo[87015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:19 devstack sudo[87015]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.info" returned: 0 in 0.459s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:19 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:19 devstack sudo[87018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.info Apr 15 10:10:19 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:20 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.info" returned: 0 in 0.439s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.580s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1419275531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c6a534a-4114-4841-9168-9aef70467fdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:12Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Creating volume 0c6a534a-4114-4841-9168-9aef70467fdb {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:20 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:20 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb 1073741824 Apr 15 10:10:20 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:20 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-044c91ac-6e00-4e0a-a846-1a98ba377d5c tempest-GroupSnapshotsTest-1483548353 None] group_snapshot 4c13c64e-ff4b-4692-9db0-44f8b689942c: created successfully Apr 15 10:10:20 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb 1073741824" returned: 0 in 0.577s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:20 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb Apr 15 10:10:20 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:21 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] group_snapshot 4c13c64e-ff4b-4692-9db0-44f8b689942c: deleting Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] group_snapshot 4c13c64e-ff4b-4692-9db0-44f8b689942c: deleting {{(pid=82600) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-57981586-ddcf-4217-b638-d5de5217279d" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-57981586-ddcf-4217-b638-d5de5217279d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Deleting offline snapshot 57981586-ddcf-4217-b638-d5de5217279d of volume 19ffc9af-c44f-4a0a-b1f4-78e5b529b453 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] snapshot_file for this snap is: volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bad299-25c9-42fd-8d6f-493c8e117ab8]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:21 devstack sudo[87028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d Apr 15 10:10:21 devstack sudo[87028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:21 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb" returned: 0 in 0.543s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.908s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Creating offline snapshot 135c86fb-efb6-43bf-8d70-f35a7f023f36 of volume 6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9fb4bf-e6ae-4c27-9119-44f6035a2fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6a534a-4114-4841-9168-9aef70467fdb', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf433a1-bbfc-41c4-854c-8c8771ccbdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cb3f00-8f90-4c7b-b301-19ea1a879434]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:21 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Volume volume-0c6a534a-4114-4841-9168-9aef70467fdb (0c6a534a-4114-4841-9168-9aef70467fdb): created successfully Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf433a1-bbfc-41c4-854c-8c8771ccbdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (98fbcb22-f32b-40aa-b2bb-acaf3860fc3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:21 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2a628b76-a0aa-4151-be35-471eeccd0049 tempest-VolumesActionsTest-1899341244 None] Created volume successfully. Apr 15 10:10:21 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab Apr 15 10:10:21 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:21 devstack sudo[87028]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d" returned: 0 in 0.616s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee4b91-17be-45c4-834e-51957f7c958b]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:21 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 Apr 15 10:10:21 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:21 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab" returned: 0 in 0.596s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:21 devstack sudo[87042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 1G Apr 15 10:10:21 devstack sudo[87042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Acquiring lock "cinder-0c6a534a-4114-4841-9168-9aef70467fdb-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Lock "cinder-0c6a534a-4114-4841-9168-9aef70467fdb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Acquiring lock "cinder-quobyte-0c6a534a-4114-4841-9168-9aef70467fdb" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Lock "cinder-quobyte-0c6a534a-4114-4841-9168-9aef70467fdb" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cbd55d-af39-4426-b6b7-41c1e33938e3]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:22 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb Apr 15 10:10:22 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:22 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" returned: 0 in 0.641s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:22 devstack sudo[87049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d Apr 15 10:10:22 devstack sudo[87049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:22 devstack sudo[87042]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 1G" returned: 0 in 0.690s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:22 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 Apr 15 10:10:22 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:22 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb" returned: 0 in 0.606s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:22 devstack sudo[87059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb Apr 15 10:10:22 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:22 devstack sudo[87049]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d" returned: 0 in 0.587s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:22 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d Apr 15 10:10:22 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:23 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36" returned: 0 in 0.521s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:23 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 is being set with open permissions: ugo+rw Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:23 devstack sudo[87070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 Apr 15 10:10:23 devstack sudo[87070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:23 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c6a534a-4114-4841-9168-9aef70467fdb" returned: 0 in 0.491s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Lock "cinder-quobyte-0c6a534a-4114-4841-9168-9aef70467fdb" released by "delete_volume" :: held 1.132s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Created reservations ['dd8e1958-779c-4e56-8a97-3d60b36e56f6', 'b5192cce-2754-4b98-bdac-0e706c7b0627', 'ade61694-8a9b-4bc6-9603-09227750f14c', '75492ca2-6082-4eec-bee0-f602dc47f982'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:23 devstack sudo[87073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:23 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:23 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453.57981586-ddcf-4217-b638-d5de5217279d" returned: 0 in 0.497s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-57981586-ddcf-4217-b638-d5de5217279d" released by "_delete_snapshot" :: held 2.408s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" released by "delete_snapshot" :: held 2.420s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-ed7218de-78ba-4119-a093-be491c43337f" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-ed7218de-78ba-4119-a093-be491c43337f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-d6301e5f-b300-4a33-a0f8-36a8e1a175dc" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-d6301e5f-b300-4a33-a0f8-36a8e1a175dc" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Deleting offline snapshot d6301e5f-b300-4a33-a0f8-36a8e1a175dc of volume ed7218de-78ba-4119-a093-be491c43337f {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] snapshot_file for this snap is: volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ae68d3-27e6-48d6-a441-96c152e68342]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:23 devstack sudo[87075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc Apr 15 10:10:23 devstack sudo[87075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:23 devstack sudo[87070]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36" returned: 0 in 0.522s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.836s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24720ef6-5544-4ce6-9aff-067428553004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330a38ebf5e945acacf13fe2fcd6545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:12Z,use_quota=True,user_id='cf64a9c0995c47f9b1cad0f5bae6fbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Creating volume 24720ef6-5544-4ce6-9aff-067428553004 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:23 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:23 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-df5b8ce0-277f-4e08-b693-7ff97aa468d6 tempest-VolumesDeleteCascade-437312007 None] Create snapshot completed successfully Apr 15 10:10:23 devstack sudo[87078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004 1073741824 Apr 15 10:10:23 devstack sudo[87078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:23 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.505s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:23 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Deleted volume successfully. Apr 15 10:10:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-425a48ab-2875-43e5-9c22-514bfca72701 tempest-VolumesActionsTest-950756866 None] Lock "cinder-0c6a534a-4114-4841-9168-9aef70467fdb-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:24 devstack sudo[87075]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc" returned: 0 in 0.559s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7218de-78ba-4119-a093-be491c43337f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[96571478-b714-4d8d-a4ae-dfe97e1c0fba]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:24 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f Apr 15 10:10:24 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:24 devstack sudo[87078]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004 1073741824" returned: 0 in 0.501s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:24 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004 Apr 15 10:10:24 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (d6a67726-0358-45d7-a9b1-464bcfca2452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112b4ca7-8184-48eb-ae47-b86454d72464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (112b4ca7-8184-48eb-ae47-b86454d72464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-823844228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b095e733-0f66-4b75-a396-6175cd71c0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:25Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09755fb4-10d3-4adc-bb42-6c3e2f89f9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09755fb4-10d3-4adc-bb42-6c3e2f89f9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e02817d-2264-454a-a37c-0814aaa84228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e02817d-2264-454a-a37c-0814aaa84228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b095e733-0f66-4b75-a396-6175cd71c0f5', 'volume_name': 'volume-b095e733-0f66-4b75-a396-6175cd71c0f5', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70596bb7-f7d9-414e-946c-f35ca04274fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70596bb7-f7d9-414e-946c-f35ca04274fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5bf60e-47f4-44c0-862f-8ef0bb3483d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Volume b095e733-0f66-4b75-a396-6175cd71c0f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b095e733-0f66-4b75-a396-6175cd71c0f5', 'volume_size': 1} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:24 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004" returned: 0 in 0.500s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.018s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-823844228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b095e733-0f66-4b75-a396-6175cd71c0f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:25Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Creating volume b095e733-0f66-4b75-a396-6175cd71c0f5 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:24 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f" returned: 0 in 0.654s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:24 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5 1073741824 Apr 15 10:10:24 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:24 devstack sudo[87096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc Apr 15 10:10:24 devstack sudo[87096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c205e192-a53b-4206-b49d-90e2d73b55b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24720ef6-5544-4ce6-9aff-067428553004', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8401e552-dc65-4a5a-ac3e-dac944ad567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:24 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Volume volume-24720ef6-5544-4ce6-9aff-067428553004 (24720ef6-5544-4ce6-9aff-067428553004): created successfully Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8401e552-dc65-4a5a-ac3e-dac944ad567f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Flow 'volume_create_manager' (597bbf12-bb03-4523-81da-02fb1d268fda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Performing cascade delete. {{(pid=82600) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 10:10:24 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6d605282-29dc-4be6-9cf3-a232c39aa3ea tempest-CinderUnicodeTest-1091479367 None] Created volume successfully. Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-135c86fb-efb6-43bf-8d70-f35a7f023f36-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-135c86fb-efb6-43bf-8d70-f35a7f023f36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-135c86fb-efb6-43bf-8d70-f35a7f023f36" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-135c86fb-efb6-43bf-8d70-f35a7f023f36" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Deleting offline snapshot 135c86fb-efb6-43bf-8d70-f35a7f023f36 of volume 6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] snapshot_file for this snap is: volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7325ca-936c-447e-91e8-ed2d4a868bc7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:24 devstack sudo[87099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 Apr 15 10:10:24 devstack sudo[87099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:25 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5 1073741824" returned: 0 in 0.555s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:25 devstack sudo[87096]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc" returned: 0 in 0.570s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:25 devstack sudo[87107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5 Apr 15 10:10:25 devstack sudo[87107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:25 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc Apr 15 10:10:25 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:25 devstack sudo[87099]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36" returned: 0 in 0.574s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5cc2b6-dcd8-44fe-b33c-28bd821a96e4]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:25 devstack sudo[87114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab Apr 15 10:10:25 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:25 devstack sudo[87107]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5" returned: 0 in 0.567s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:25 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f.d6301e5f-b300-4a33-a0f8-36a8e1a175dc" returned: 0 in 0.564s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5bf60e-47f4-44c0-862f-8ef0bb3483d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b095e733-0f66-4b75-a396-6175cd71c0f5', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd77078c-95dc-483b-997b-bc83669da6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-d6301e5f-b300-4a33-a0f8-36a8e1a175dc" released by "_delete_snapshot" :: held 2.428s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:25 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Volume volume-b095e733-0f66-4b75-a396-6175cd71c0f5 (b095e733-0f66-4b75-a396-6175cd71c0f5): created successfully Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd77078c-95dc-483b-997b-bc83669da6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (d6a67726-0358-45d7-a9b1-464bcfca2452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-ed7218de-78ba-4119-a093-be491c43337f" released by "delete_snapshot" :: held 2.455s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Flow 'volume_create_manager' (a53a10bf-bdd7-4021-a275-3354ba8e44f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed7d695-f0e8-4afd-a670-ca63d4b920f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:25 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-41a515cd-9bd2-47d1-a82e-d39ef69d8e68 tempest-VolumesActionsTest-1899341244 None] Created volume successfully. Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed7d695-f0e8-4afd-a670-ca63d4b920f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-438897957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3ad2cc-3591-481c-a90c-07ec2d57a4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330a38ebf5e945acacf13fe2fcd6545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:26Z,use_quota=True,user_id='cf64a9c0995c47f9b1cad0f5bae6fbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad41892-0d68-4bc8-a800-8e3dd5ec3bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad41892-0d68-4bc8-a800-8e3dd5ec3bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e8f1fc-90f7-4629-875a-70d3495abfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e8f1fc-90f7-4629-875a-70d3495abfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be3ad2cc-3591-481c-a90c-07ec2d57a4a0', 'volume_name': 'volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d465123-bb97-4630-aa6b-a27d8b89b59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d465123-bb97-4630-aa6b-a27d8b89b59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19bf751-d640-4d4c-99ed-bbb03a94a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:26 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Volume be3ad2cc-3591-481c-a90c-07ec2d57a4a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0', 'volume_size': 1} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-438897957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be3ad2cc-3591-481c-a90c-07ec2d57a4a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='330a38ebf5e945acacf13fe2fcd6545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:26Z,use_quota=True,user_id='cf64a9c0995c47f9b1cad0f5bae6fbb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Creating volume be3ad2cc-3591-481c-a90c-07ec2d57a4a0 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:26 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 1073741824 Apr 15 10:10:26 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:26 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab" returned: 0 in 0.590s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack sudo[87123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 Apr 15 10:10:26 devstack sudo[87123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack cinder-volume[82600]: WARNING cinder.quota [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1788625381 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1788625381, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:26 devstack cinder-volume[82600]: WARNING cinder.quota [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1788625381 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1788625381, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['4fc4b6eb-c2d0-4fbb-af55-324bb17a2671', '5f4adb9a-d712-4fe6-878c-9132d73220ff', '568a5953-506a-4e46-b160-85c27bb210e2', '23971675-d7a6-46dd-abab-27013af8f141'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['ee831edd-4952-4658-829a-cc510e7504c0', '29c4d70a-b95c-4bde-bcb7-1c25d33d23dc', '92456d60-b42f-49b0-b940-62fcf1a19cb6', '97a9155a-92c7-4292-a81a-8033fd7e029f'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:26 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c33adb4e-9870-4c44-a4ec-a692dcec6e68 tempest-GroupSnapshotsTest-1483548353 None] group_snapshot 4c13c64e-ff4b-4692-9db0-44f8b689942c: deleted successfully Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:26 devstack sudo[87123]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36" returned: 0 in 0.573s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50de57f-e8e0-417c-bec6-49c2382a3b79]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 1073741824" returned: 0 in 0.649s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:26 devstack sudo[87131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36 Apr 15 10:10:26 devstack sudo[87131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:26 devstack sudo[87134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 Apr 15 10:10:26 devstack sudo[87134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 Apr 15 10:10:26 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Acquiring lock "cinder-b095e733-0f66-4b75-a396-6175cd71c0f5-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Lock "cinder-b095e733-0f66-4b75-a396-6175cd71c0f5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Acquiring lock "cinder-quobyte-b095e733-0f66-4b75-a396-6175cd71c0f5" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Lock "cinder-quobyte-b095e733-0f66-4b75-a396-6175cd71c0f5" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[715cef6c-f93a-4080-a446-eed774695348]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:27 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5 Apr 15 10:10:27 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:27 devstack sudo[87134]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" returned: 0 in 0.511s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:27 devstack sudo[87131]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b19bf751-d640-4d4c-99ed-bbb03a94a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:27 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05e2f9d-feff-423a-85bb-20a1d926f265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.135c86fb-efb6-43bf-8d70-f35a7f023f36" returned: 0 in 0.596s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" returned: 0 in 0.596s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:27 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Volume volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 (be3ad2cc-3591-481c-a90c-07ec2d57a4a0): created successfully Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05e2f9d-feff-423a-85bb-20a1d926f265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Flow 'volume_create_manager' (a53a10bf-bdd7-4021-a275-3354ba8e44f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:27 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453 Apr 15 10:10:27 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-135c86fb-efb6-43bf-8d70-f35a7f023f36" released by "_delete_snapshot" :: held 2.416s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:27 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-bc58d620-202f-4a4d-86f6-60ae0db7e40a tempest-CinderUnicodeTest-1091479367 None] Created volume successfully. Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" released by "delete_snapshot" :: held 2.433s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Created reservations ['89a77c74-faa7-46b5-8387-2240dd43c270', 'e76cf429-436e-400f-b708-fbbd09ba0ee2', 'ea067681-5efd-4263-be8d-df67e6b58658', '8b706d6e-76e2-4a6d-bd82-92188b8a40b8'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:27 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Delete snapshot completed successfully. Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-135c86fb-efb6-43bf-8d70-f35a7f023f36-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-de207ef8-0f58-4790-b67d-3eaf20fe17ab-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-de207ef8-0f58-4790-b67d-3eaf20fe17ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-de207ef8-0f58-4790-b67d-3eaf20fe17ab" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-de207ef8-0f58-4790-b67d-3eaf20fe17ab" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Deleting offline snapshot de207ef8-0f58-4790-b67d-3eaf20fe17ab of volume 6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] snapshot_file for this snap is: volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae847be5-f093-4801-9045-b3b7a4b52488]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:27 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab Apr 15 10:10:27 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:27 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5" returned: 0 in 0.565s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:27 devstack sudo[87151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5 Apr 15 10:10:27 devstack sudo[87151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:27 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" returned: 0 in 0.503s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-19ffc9af-c44f-4a0a-b1f4-78e5b529b453" released by "delete_volume" :: held 1.149s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-ed7218de-78ba-4119-a093-be491c43337f" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-ed7218de-78ba-4119-a093-be491c43337f" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7974120f-760c-445a-8159-d6c5474abbf7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:27 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f Apr 15 10:10:27 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:27 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab" returned: 0 in 0.555s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[135e5423-5595-4e2f-a189-d565d4ed5d65]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87151]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b095e733-0f66-4b75-a396-6175cd71c0f5" returned: 0 in 0.502s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Lock "cinder-quobyte-b095e733-0f66-4b75-a396-6175cd71c0f5" released by "delete_volume" :: held 1.096s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:28 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 Apr 15 10:10:28 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Created reservations ['89a1d109-bb9c-4312-bc04-37270b5594cb', '7de48f9f-2f62-4dff-96b3-091da9109fd5', 'a41a8b0d-3f97-4003-a561-de6217909fcf', '273d57e1-5d64-4d51-b5ac-1e0dd5c0a97b'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:28 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Creating offline snapshot 4dd9e07b-0a6a-4265-aa58-80d0abf81195 of volume be3ad2cc-3591-481c-a90c-07ec2d57a4a0 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ced5be-d88c-41d3-99c3-8042ccb3e103]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 Apr 15 10:10:28 devstack sudo[87167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f" returned: 0 in 0.606s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f Apr 15 10:10:28 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" returned: 0 in 0.637s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab Apr 15 10:10:28 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.507s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:28 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Deleted volume successfully. Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0f75646-60e8-40dc-9373-53da781da1e4 tempest-VolumesActionsTest-950756866 None] Lock "cinder-b095e733-0f66-4b75-a396-6175cd71c0f5-delete_volume" released by "delete_volume" :: held 1.830s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:28 devstack sudo[87167]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" returned: 0 in 0.569s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:28 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 1G Apr 15 10:10:28 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:28 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ed7218de-78ba-4119-a093-be491c43337f" returned: 0 in 0.516s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-ed7218de-78ba-4119-a093-be491c43337f" released by "delete_volume" :: held 1.158s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['68fc3108-0872-4ac1-b2b7-ecc21913e9c5'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:29 devstack cinder-volume[82600]: WARNING cinder.quota [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1788625381 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1788625381, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['5de03e4c-16ed-4771-b65b-a5987b46f63e', 'dde88a33-0d0a-487a-a58d-8213581e2003', 'b5268d6f-84cd-44f3-89d1-c8d4d55751ca', '28c6d075-aa71-4234-98c2-a8151cfe31fd'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['e2f8820d-2baf-4c79-9466-78fddde51b7a', '7415c6ce-6949-4772-a646-2e81614be2ba', '118327e9-c470-4613-8b84-85bb471abe5f', 'faeca321-a76f-4b94-9d8f-620fe7808d09'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab" returned: 0 in 0.593s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[87186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:29 devstack sudo[87186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack sudo[87187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab Apr 15 10:10:29 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (13d78314-3082-4996-9c12-0edb0b4cc8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bcc620-2f5f-49f9-aca9-8902e73e0d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85bcc620-2f5f-49f9-aca9-8902e73e0d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-246734896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebf1ced-79f5-4599-9cd4-653b098ea5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:29Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8c93dc-24d3-46ed-b555-11b5e9b9276d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf8c93dc-24d3-46ed-b555-11b5e9b9276d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac37766-4dae-4435-8a54-6c52df1a3503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:29 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac37766-4dae-4435-8a54-6c52df1a3503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ebf1ced-79f5-4599-9cd4-653b098ea5f2', 'volume_name': 'volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176eefa2-bf52-4682-9213-be71e0ed0a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (176eefa2-bf52-4682-9213-be71e0ed0a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810ec153-fc64-49a5-9e66-fb2ac2de78d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:29 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Volume 2ebf1ced-79f5-4599-9cd4-653b098ea5f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2', 'volume_size': 1} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 1G" returned: 0 in 0.703s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:29 devstack sudo[87193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 Apr 15 10:10:29 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:29 devstack sudo[87186]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.529s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:29 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-22d90297-a3d0-40ba-81ce-0a30cae81e44 tempest-GroupSnapshotsTest-1483548353 None] Delete group completed successfully. Apr 15 10:10:29 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54.de207ef8-0f58-4790-b67d-3eaf20fe17ab" returned: 0 in 0.563s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-de207ef8-0f58-4790-b67d-3eaf20fe17ab" released by "_delete_snapshot" :: held 2.409s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" released by "delete_snapshot" :: held 2.424s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Created reservations ['3b62f6e8-b76b-4402-b024-1e53bf11521f', 'b69eb76d-b9e0-48b9-b43c-f98fe803a398', 'cf193172-8e68-4153-9e2e-d41f130f554e', '19e2ec12-5f7e-4277-a6e0-08cf35ab2aa9'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:29 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Delete snapshot completed successfully. Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-de207ef8-0f58-4790-b67d-3eaf20fe17ab-delete_snapshot" released by "delete_snapshot" :: held 2.538s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Snapshots deleted, issuing volume delete {{(pid=82600) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1774dc-0151-483d-82ee-209152481453]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 Apr 15 10:10:30 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195" returned: 0 in 0.563s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 is being set with open permissions: ugo+rw Apr 15 10:10:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[87202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 Apr 15 10:10:30 devstack sudo[87202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b1fa9ddf-47e7-4cf6-ac29-06291aae60a5 tempest-GroupSnapshotsTest-1483548353 None] Group tempest-GroupSnapshotsTest-Group-72078401: creating Apr 15 10:10:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b1fa9ddf-47e7-4cf6-ac29-06291aae60a5 tempest-GroupSnapshotsTest-1483548353 None] Group tempest-GroupSnapshotsTest-Group-72078401: created successfully Apr 15 10:10:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b1fa9ddf-47e7-4cf6-ac29-06291aae60a5 tempest-GroupSnapshotsTest-1483548353 None] Create group completed successfully. Apr 15 10:10:30 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" returned: 0 in 0.576s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54 Apr 15 10:10:30 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack sudo[87202]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195" returned: 0 in 0.492s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:30 devstack sudo[87210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.info Apr 15 10:10:30 devstack sudo[87210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:30 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" returned: 0 in 0.452s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54" released by "delete_volume" :: held 1.062s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Created reservations ['4cea8017-b255-41d3-bf15-8280636a0cd2', 'a7984f42-357a-4139-8088-75363459d2b8', '1cc67171-d072-4c7e-97dd-2cf313470ea4', 'd25bdf4e-d8a1-42ed-aff1-f01cd2a7829a'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:31 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:31 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:31 devstack sudo[87210]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.info" returned: 0 in 0.544s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:31 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.info is being set with open permissions: ugo+rw Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:31 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.info Apr 15 10:10:31 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:31 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.480s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:31 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Deleted volume successfully. Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cf8503e0-6508-41da-b2c9-53f453ce5c52 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-6c3b1b52-f05a-4a5d-ba69-c79c5d907d54-delete_volume" released by "delete_volume" :: held 6.838s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Flow 'volume_create_manager' (24e033c3-8906-4979-b039-ef102d0789d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37979870-0a8d-4e08-ad87-066d8b9a2bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37979870-0a8d-4e08-ad87-066d8b9a2bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-848197485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27594d27-9168-4169-977f-8d1e460f6e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a3002db4956482bb2f62025a1301ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:32Z,use_quota=True,user_id='e4b8923029334d079f09b6056d3de3b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10570a4-c448-4b48-989a-76bff05d9be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10570a4-c448-4b48-989a-76bff05d9be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361b8dad-c552-4bf3-b47e-fc32d7ec2f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (361b8dad-c552-4bf3-b47e-fc32d7ec2f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27594d27-9168-4169-977f-8d1e460f6e50', 'volume_name': 'volume-27594d27-9168-4169-977f-8d1e460f6e50', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f2a5c9d-e298-432f-964b-bbff12d93b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f2a5c9d-e298-432f-964b-bbff12d93b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0415e8e-bde8-4075-b52a-19330ce31243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Volume 27594d27-9168-4169-977f-8d1e460f6e50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27594d27-9168-4169-977f-8d1e460f6e50', 'volume_size': 1} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Flow 'volume_create_manager' (8b1c25c7-f677-4ddf-96ab-dae745bc83e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f006b15-6ac9-4c01-a4a7-655edba8bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f006b15-6ac9-4c01-a4a7-655edba8bd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1042595349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0e26094-4ba2-45a5-90df-ad8740a2e885,host='devstack@QuobyteHD#QuobyteHD',id=be47dd7c-7d71-49e0-ad43-9a6796ee98b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce87d9b7fe545fd908a1d49cc73277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:32Z,use_quota=True,user_id='90f3a6681f344e14bbe032a9eea5369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6956d681-dcf8-42a5-a78b-5dfe7daab8ea),volume_type_id=6956d681-dcf8-42a5-a78b-5dfe7daab8ea)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66516bd-ef1d-442f-8b8b-e8c62ba251f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66516bd-ef1d-442f-8b8b-e8c62ba251f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11de355-f083-40dc-8fcb-68e6bfad91cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d11de355-f083-40dc-8fcb-68e6bfad91cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be47dd7c-7d71-49e0-ad43-9a6796ee98b8', 'volume_name': 'volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d383f70b-12c0-4561-b1f6-2952fa52ccd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d383f70b-12c0-4561-b1f6-2952fa52ccd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3735ba7c-8b91-4b35-bb3e-a520467ba25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:31 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Volume be47dd7c-7d71-49e0-ad43-9a6796ee98b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8', 'volume_size': 1} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:31 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.info" returned: 0 in 0.655s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.597s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.299s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-246734896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ebf1ced-79f5-4599-9cd4-653b098ea5f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:29Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Creating volume 2ebf1ced-79f5-4599-9cd4-653b098ea5f2 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:31 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:31 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 1073741824 Apr 15 10:10:31 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:31 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-51fe17fc-0e99-4b69-8868-f0c00e821503 tempest-CinderUnicodeTest-1091479367 None] Create snapshot completed successfully Apr 15 10:10:32 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 1073741824" returned: 0 in 0.552s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:32 devstack sudo[87231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 Apr 15 10:10:32 devstack sudo[87231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "cinder-4dd9e07b-0a6a-4265-aa58-80d0abf81195-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-4dd9e07b-0a6a-4265-aa58-80d0abf81195-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "cinder-quobyte-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-quobyte-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "cinder-quobyte-4dd9e07b-0a6a-4265-aa58-80d0abf81195" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-quobyte-4dd9e07b-0a6a-4265-aa58-80d0abf81195" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Deleting offline snapshot 4dd9e07b-0a6a-4265-aa58-80d0abf81195 of volume be3ad2cc-3591-481c-a90c-07ec2d57a4a0 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] snapshot_file for this snap is: volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[685c9c76-a715-4ddb-8bbf-865138841700]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:32 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 Apr 15 10:10:32 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack sudo[87231]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2" returned: 0 in 0.496s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.239s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-848197485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27594d27-9168-4169-977f-8d1e460f6e50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a3002db4956482bb2f62025a1301ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:32Z,use_quota=True,user_id='e4b8923029334d079f09b6056d3de3b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Creating volume 27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:32 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (810ec153-fc64-49a5-9e66-fb2ac2de78d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:32 devstack sudo[87236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 1073741824 Apr 15 10:10:32 devstack sudo[87236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa457542-16aa-4ff8-904f-11e2609a1c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:33 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Volume volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 (2ebf1ced-79f5-4599-9cd4-653b098ea5f2): created successfully Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa457542-16aa-4ff8-904f-11e2609a1c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (13d78314-3082-4996-9c12-0edb0b4cc8cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:33 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1bcf5b95-f4a1-4ede-875a-c0689e7b5241 tempest-VolumesActionsTest-1899341244 None] Created volume successfully. Apr 15 10:10:33 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195" returned: 0 in 0.567s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeca128b-b73a-4782-b709-8d07802aea1c]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:33 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 Apr 15 10:10:33 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:33 devstack sudo[87236]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 1073741824" returned: 0 in 0.560s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:33 devstack sudo[87246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 Apr 15 10:10:33 devstack sudo[87246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:33 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" returned: 0 in 0.613s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:33 devstack sudo[87251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 Apr 15 10:10:33 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Acquiring lock "cinder-2ebf1ced-79f5-4599-9cd4-653b098ea5f2-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Lock "cinder-2ebf1ced-79f5-4599-9cd4-653b098ea5f2-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Acquiring lock "cinder-quobyte-2ebf1ced-79f5-4599-9cd4-653b098ea5f2" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Lock "cinder-quobyte-2ebf1ced-79f5-4599-9cd4-653b098ea5f2" acquired by "delete_volume" :: waited 0.022s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f83e522-4cc3-47c3-8042-63e8fe48e282]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack sudo[87246]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50" returned: 0 in 0.540s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f0e26094-4ba2-45a5-90df-ad8740a2e885,created_at=2026-04-15T08:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1042595349',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f0e26094-4ba2-45a5-90df-ad8740a2e885,host='devstack@QuobyteHD#QuobyteHD',id=be47dd7c-7d71-49e0-ad43-9a6796ee98b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ce87d9b7fe545fd908a1d49cc73277d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:32Z,use_quota=True,user_id='90f3a6681f344e14bbe032a9eea5369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6956d681-dcf8-42a5-a78b-5dfe7daab8ea),volume_type_id=6956d681-dcf8-42a5-a78b-5dfe7daab8ea)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Creating volume be47dd7c-7d71-49e0-ad43-9a6796ee98b8 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:34 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0415e8e-bde8-4075-b52a-19330ce31243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27594d27-9168-4169-977f-8d1e460f6e50', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f737a2-2c07-478c-979a-39937eb406ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:34 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 1073741824 Apr 15 10:10:34 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:34 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Volume volume-27594d27-9168-4169-977f-8d1e460f6e50 (27594d27-9168-4169-977f-8d1e460f6e50): created successfully Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30f737a2-2c07-478c-979a-39937eb406ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Flow 'volume_create_manager' (24e033c3-8906-4979-b039-ef102d0789d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:34 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-05b084d0-1ef2-4dd5-95cf-ec956988a93e tempest-VolumesDeleteCascade-437312007 None] Created volume successfully. Apr 15 10:10:34 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 Apr 15 10:10:34 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:34 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195" returned: 0 in 0.573s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack sudo[87262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195 Apr 15 10:10:34 devstack sudo[87262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:34 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2" returned: 0 in 0.568s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2 Apr 15 10:10:34 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:34 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 1073741824" returned: 0 in 0.597s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:34 devstack sudo[87271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 Apr 15 10:10:34 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:35 devstack sudo[87262]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0.4dd9e07b-0a6a-4265-aa58-80d0abf81195" returned: 0 in 0.575s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-quobyte-4dd9e07b-0a6a-4265-aa58-80d0abf81195" released by "_delete_snapshot" :: held 2.393s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-quobyte-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" released by "delete_snapshot" :: held 2.416s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Created reservations ['953b8d0a-51eb-459b-9833-00d6293c5a14', '36c966b4-a158-4157-b9dd-bb34c31694fb', 'aaa911a5-5913-4e99-b23c-99a72abe7d2c', 'd5e61648-e6f1-4ade-b3ee-28c3b0046ea3'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:35 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Delete snapshot completed successfully. Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9a9c4f24-a44b-44e6-9293-5827a55c7d57 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-4dd9e07b-0a6a-4265-aa58-80d0abf81195-delete_snapshot" released by "delete_snapshot" :: held 2.537s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:35 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2ebf1ced-79f5-4599-9cd4-653b098ea5f2" returned: 0 in 0.576s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Lock "cinder-quobyte-2ebf1ced-79f5-4599-9cd4-653b098ea5f2" released by "delete_volume" :: held 1.169s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Created reservations ['a5939190-10b4-4812-933c-43cd51663329', 'f870d0dc-e17a-462e-8989-1eb57b92ab62', 'a11af370-ec68-478d-a1a4-e06cad90b3b3', '6b4a767a-baa2-414a-ad93-dddc0010cc92'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:35 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" returned: 0 in 0.618s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.355s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3735ba7c-8b91-4b35-bb3e-a520467ba25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6770df7b-d807-461c-aecb-3d0a911a7b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Creating offline snapshot f0b675b3-626d-434f-b3fe-7e19b45437cd of volume 27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:35 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Volume volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 (be47dd7c-7d71-49e0-ad43-9a6796ee98b8): created successfully Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6770df7b-d807-461c-aecb-3d0a911a7b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Flow 'volume_create_manager' (8b1c25c7-f677-4ddf-96ab-dae745bc83e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3d7419-5a7c-4a5a-b785-0b301874a812]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-5f67259d-9e82-403b-99a6-c47a751a4581 tempest-GroupSnapshotsTest-1483548353 None] Created volume successfully. Apr 15 10:10:35 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 Apr 15 10:10:35 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.474s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:35 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Deleted volume successfully. Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f7692def-4f08-45b8-875c-17314e04874d tempest-VolumesActionsTest-950756866 None] Lock "cinder-2ebf1ced-79f5-4599-9cd4-653b098ea5f2-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "cinder-be3ad2cc-3591-481c-a90c-07ec2d57a4a0-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-be3ad2cc-3591-481c-a90c-07ec2d57a4a0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "cinder-quobyte-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-quobyte-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[11309b68-6825-4f37-b24a-c238211f6c7e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50" returned: 0 in 0.526s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:35 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd 1G Apr 15 10:10:35 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:35 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 Apr 15 10:10:35 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:36 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] GroupSnapshot f847fc6a-97bf-49de-a590-d71645da5dbf: creating. Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Group snapshot f847fc6a-97bf-49de-a590-d71645da5dbf: creating. {{(pid=82600) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:36 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" returned: 0 in 0.617s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:36 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0 Apr 15 10:10:36 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (ba8ca289-a71b-4cf6-bb7a-4c3b71d37fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef997f5-5979-4685-8042-c89021ea32c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef997f5-5979-4685-8042-c89021ea32c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-233359630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e166b4-6355-46dc-9792-8e7d0468e224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:37Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460f32ff-bb74-420a-b3a9-2452f170940c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460f32ff-bb74-420a-b3a9-2452f170940c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30747d0-0416-4a28-aaac-45f4fab839d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30747d0-0416-4a28-aaac-45f4fab839d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6e166b4-6355-46dc-9792-8e7d0468e224', 'volume_name': 'volume-d6e166b4-6355-46dc-9792-8e7d0468e224', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:36 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137f9836-c251-479f-aaf7-193f73aa0d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137f9836-c251-479f-aaf7-193f73aa0d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b0684c-1974-4aa6-a9a2-0a1abf96182f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:36 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Volume d6e166b4-6355-46dc-9792-8e7d0468e224: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6e166b4-6355-46dc-9792-8e7d0468e224', 'volume_size': 1} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd 1G" returned: 0 in 0.711s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27594d27-9168-4169-977f-8d1e460f6e50 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:36 devstack sudo[87296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27594d27-9168-4169-977f-8d1e460f6e50 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd Apr 15 10:10:36 devstack sudo[87296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:37 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" returned: 0 in 0.487s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-quobyte-be3ad2cc-3591-481c-a90c-07ec2d57a4a0" released by "delete_volume" :: held 1.142s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Created reservations ['9669bfa6-3cc6-4961-8414-48b011ac951c', 'e680ab19-f98d-4019-9666-96a8f5417d6e', 'ae0e1c90-a125-4c72-ba75-fcaaea20367c', 'b897da29-b9c9-47f6-8f9e-79313831666d'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:37 devstack sudo[87302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:37 devstack sudo[87302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:37 devstack sudo[87296]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27594d27-9168-4169-977f-8d1e460f6e50 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd" returned: 0 in 0.511s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:37 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd is being set with open permissions: ugo+rw Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:37 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd Apr 15 10:10:37 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:37 devstack sudo[87302]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.525s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:37 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Deleted volume successfully. Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7bd6974a-04c0-4049-8f42-40e327627bd1 tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-be3ad2cc-3591-481c-a90c-07ec2d57a4a0-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:37 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd" returned: 0 in 0.522s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:37 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.info Apr 15 10:10:37 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "cinder-24720ef6-5544-4ce6-9aff-067428553004-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-24720ef6-5544-4ce6-9aff-067428553004-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "cinder-quobyte-24720ef6-5544-4ce6-9aff-067428553004" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-quobyte-24720ef6-5544-4ce6-9aff-067428553004" acquired by "delete_volume" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[64db6cee-70d7-42fc-a1dc-32329d48897c]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:38 devstack sudo[87310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004 Apr 15 10:10:38 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.info" returned: 0 in 0.537s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:38 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.info is being set with open permissions: ugo+rw Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:38 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.info Apr 15 10:10:38 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004" returned: 0 in 0.556s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:38 devstack sudo[87318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004 Apr 15 10:10:38 devstack sudo[87318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:38 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.info" returned: 0 in 0.552s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.452s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.538s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Creating offline snapshot 46d468a9-812c-4b99-934e-51c8386afb34 of volume be47dd7c-7d71-49e0-ad43-9a6796ee98b8 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:38 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-faf5e0f0-51ef-45cc-86df-45ba0f5812b4 tempest-VolumesDeleteCascade-437312007 None] Create snapshot completed successfully Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eef25b-2b79-4e05-91aa-856f2abf0763]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:38 devstack sudo[87321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 Apr 15 10:10:38 devstack sudo[87321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:39 devstack sudo[87318]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-24720ef6-5544-4ce6-9aff-067428553004" returned: 0 in 0.512s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-quobyte-24720ef6-5544-4ce6-9aff-067428553004" released by "delete_volume" :: held 1.113s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Created reservations ['f00e04ef-d707-484a-8790-db535690b508', '024c0641-e190-4551-b6e6-25463676bc75', 'b9cdf3a8-246b-4367-bcdc-eb9129dafb82', '779ea5b2-bf4a-4af1-ad8c-b31ca767bf10'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:39 devstack sudo[87326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:39 devstack sudo[87326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:39 devstack sudo[87321]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" returned: 0 in 0.597s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:39 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 1G Apr 15 10:10:39 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Flow 'volume_create_manager' (aa802c30-4dd6-4e50-b214-44e37fa0ecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f8fe17-623a-4f58-b8c0-0aeb1722c832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f8fe17-623a-4f58-b8c0-0aeb1722c832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1573423853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2704a9ec-5147-4199-bc6b-a5ac4a1c69d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a3002db4956482bb2f62025a1301ca2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f0b675b3-626d-434f-b3fe-7e19b45437cd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:40Z,use_quota=True,user_id='e4b8923029334d079f09b6056d3de3b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b39922c-9728-4e3a-aa35-135da08eeb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b39922c-9728-4e3a-aa35-135da08eeb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c8843a-256d-4942-96b1-2893e0941c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49c8843a-256d-4942-96b1-2893e0941c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2704a9ec-5147-4199-bc6b-a5ac4a1c69d5', 'volume_name': 'volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5', 'volume_size': 1, 'snapshot_id': 'f0b675b3-626d-434f-b3fe-7e19b45437cd'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1af213f-dcc6-4934-bee9-777bfcc1cb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1af213f-dcc6-4934-bee9-777bfcc1cb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854e55e8-e9b5-4228-a51b-3e34cd1d0f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:39 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Volume 2704a9ec-5147-4199-bc6b-a5ac4a1c69d5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5', 'volume_size': 1, 'snapshot_id': 'f0b675b3-626d-434f-b3fe-7e19b45437cd'} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:39 devstack sudo[87326]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.526s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:39 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Deleted volume successfully. Apr 15 10:10:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-22da0f51-faf2-4421-819b-c0ca15a1152f tempest-CinderUnicodeTest-1091479367 None] Lock "cinder-24720ef6-5544-4ce6-9aff-067428553004-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:40 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 1G" returned: 0 in 0.564s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:40 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 Apr 15 10:10:40 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:40 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34" returned: 0 in 0.485s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:40 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:40 devstack sudo[87340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 Apr 15 10:10:40 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:41 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34" returned: 0 in 0.515s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:41 devstack sudo[87344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.info Apr 15 10:10:41 devstack sudo[87344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:41 devstack sudo[87344]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.info" returned: 0 in 0.472s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:41 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:41 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.info Apr 15 10:10:41 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:42 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.info" returned: 0 in 0.458s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.181s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.367s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-233359630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6e166b4-6355-46dc-9792-8e7d0468e224,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:37Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Creating volume d6e166b4-6355-46dc-9792-8e7d0468e224 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:42 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:42 devstack sudo[87351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224 1073741824 Apr 15 10:10:42 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:42 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7cea67bb-aafc-4e7c-9509-dfa41b865ed6 tempest-GroupSnapshotsTest-1483548353 None] group_snapshot f847fc6a-97bf-49de-a590-d71645da5dbf: created successfully Apr 15 10:10:42 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224 1073741824" returned: 0 in 0.546s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:42 devstack sudo[87356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224 Apr 15 10:10:42 devstack sudo[87356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:42 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] group_snapshot f847fc6a-97bf-49de-a590-d71645da5dbf: deleting Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] group_snapshot f847fc6a-97bf-49de-a590-d71645da5dbf: deleting {{(pid=82600) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-46d468a9-812c-4b99-934e-51c8386afb34" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-46d468a9-812c-4b99-934e-51c8386afb34" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Deleting offline snapshot 46d468a9-812c-4b99-934e-51c8386afb34 of volume be47dd7c-7d71-49e0-ad43-9a6796ee98b8 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] snapshot_file for this snap is: volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc62f57-deaf-41a9-841a-5eb074ff0945]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:42 devstack sudo[87358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 Apr 15 10:10:42 devstack sudo[87358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:43 devstack sudo[87356]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224" returned: 0 in 0.455s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.249s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-f0b675b3-626d-434f-b3fe-7e19b45437cd-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" by "_create_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4b0684c-1974-4aa6-a9a2-0a1abf96182f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6e166b4-6355-46dc-9792-8e7d0468e224', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566a00fa-6964-4fcb-b7dc-c4a93583c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:43 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Volume volume-d6e166b4-6355-46dc-9792-8e7d0468e224 (d6e166b4-6355-46dc-9792-8e7d0468e224): created successfully Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (566a00fa-6964-4fcb-b7dc-c4a93583c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (ba8ca289-a71b-4cf6-bb7a-4c3b71d37fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-f0b675b3-626d-434f-b3fe-7e19b45437cd-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Creating volume 2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 from snapshot f0b675b3-626d-434f-b3fe-7e19b45437cd {{(pid=82600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:43 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2ddfb134-ae45-4e0d-bf9e-f6d41aa6a393 tempest-VolumesActionsTest-1899341244 None] Created volume successfully. Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] snapshot: f0b675b3-626d-434f-b3fe-7e19b45437cd, volume: 2704a9ec-5147-4199-bc6b-a5ac4a1c69d5, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[763950f0-5f18-4f08-be44-aa6a3cfad902]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:43 devstack sudo[87361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd Apr 15 10:10:43 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:43 devstack sudo[87358]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34" returned: 0 in 0.548s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[32407dce-e066-423a-9e74-4b3ffdd4818d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:43 devstack sudo[87366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 Apr 15 10:10:43 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:43 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd" returned: 0 in 0.538s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27594d27-9168-4169-977f-8d1e460f6e50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0580a0a-cfe8-43f6-9d0c-4126f755bb89]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:43 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 Apr 15 10:10:43 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:43 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" returned: 0 in 0.515s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:43 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 Apr 15 10:10:43 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Acquiring lock "cinder-d6e166b4-6355-46dc-9792-8e7d0468e224-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Lock "cinder-d6e166b4-6355-46dc-9792-8e7d0468e224-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Acquiring lock "cinder-quobyte-d6e166b4-6355-46dc-9792-8e7d0468e224" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Lock "cinder-quobyte-d6e166b4-6355-46dc-9792-8e7d0468e224" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf067e4f-440f-46c8-8c43-3719ed439f74]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:44 devstack sudo[87380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224 Apr 15 10:10:44 devstack sudo[87380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:44 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50" returned: 0 in 0.603s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:44 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 Apr 15 10:10:44 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:44 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34" returned: 0 in 0.554s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:44 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34 Apr 15 10:10:44 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:44 devstack sudo[87380]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224" returned: 0 in 0.613s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:44 devstack sudo[87402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224 Apr 15 10:10:44 devstack sudo[87402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:44 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8.46d468a9-812c-4b99-934e-51c8386afb34" returned: 0 in 0.612s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-46d468a9-812c-4b99-934e-51c8386afb34" released by "_delete_snapshot" :: held 2.312s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" released by "delete_snapshot" :: held 2.332s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:45 devstack cinder-volume[82600]: WARNING cinder.quota [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1428591757 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1428591757, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:45 devstack cinder-volume[82600]: WARNING cinder.quota [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1428591757 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1428591757, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:45 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['651b314a-e5cb-487c-92bb-223e6e6064a2', '65088ef8-bc55-445a-8579-87a16b8064ec', '7d8d5c39-249c-4a29-89e9-a1fa6f4c00b2', '10ae5b6b-3d67-45eb-93d7-4e8f392e6871'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-21043fab-3c87-4373-ba25-a59c7ff990cb tempest-GroupSnapshotsTest-1483548353 None] group_snapshot f847fc6a-97bf-49de-a590-d71645da5dbf: deleted successfully Apr 15 10:10:45 devstack sudo[87402]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d6e166b4-6355-46dc-9792-8e7d0468e224" returned: 0 in 1.096s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Lock "cinder-quobyte-d6e166b4-6355-46dc-9792-8e7d0468e224" released by "delete_volume" :: held 1.738s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:45 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Created reservations ['e3f41ed2-d2a9-4501-8d2d-0cb550e7c01f', 'dbf03873-5db9-49df-bde1-a3b22d2f6a73', 'e72ce271-5164-4c8f-ba35-073deb38b23a', 'a9050665-899b-403c-b506-0aa552008717'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:46 devstack sudo[87408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:46 devstack sudo[87408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:46 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" returned: 0 in 2.326s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "cinder-quobyte-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[92877fdc-f82b-43c0-a2c7-88ccd6e142fc]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" acquired by "delete_volume" :: waited 0.032s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baf3c53-3fe0-41ee-bb2f-3658603cbd1d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:46 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 Apr 15 10:10:46 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:46 devstack sudo[87411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 Apr 15 10:10:46 devstack sudo[87411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (f94412c1-c226-4e35-ae64-8e278fee1c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42cbb744-a93c-4fc6-9956-cacbc31c07a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42cbb744-a93c-4fc6-9956-cacbc31c07a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1050656378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777360e7-3b9d-4dba-ba32-20d074b5e1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:47Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e309ed70-3084-4847-9a3b-1c0f4743b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e309ed70-3084-4847-9a3b-1c0f4743b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484b1dfb-e49a-4927-ba6b-b3376c0226a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (484b1dfb-e49a-4927-ba6b-b3376c0226a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '777360e7-3b9d-4dba-ba32-20d074b5e1c0', 'volume_name': 'volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546d0dd0-0dc0-484e-af5f-c9d444b9a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (546d0dd0-0dc0-484e-af5f-c9d444b9a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6805aa6-2f82-41bd-93da-b3a186b58af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:47 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Volume 777360e7-3b9d-4dba-ba32-20d074b5e1c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0', 'volume_size': 1} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:47 devstack sudo[87408]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.871s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:47 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Deleted volume successfully. Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ad4f674-4f81-4f16-9bb9-87e62c61611a tempest-VolumesActionsTest-950756866 None] Lock "cinder-d6e166b4-6355-46dc-9792-8e7d0468e224-delete_volume" released by "delete_volume" :: held 2.946s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:47 devstack sudo[87411]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" returned: 0 in 0.552s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:47 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8 Apr 15 10:10:47 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:47 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50" returned: 0 in 0.744s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50, size 1024.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:10:47 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Converted 1024.00 MB image at 440.09 MB/s Apr 15 10:10:47 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 is being set with open permissions: ugo+rw Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:47 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 Apr 15 10:10:47 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:47 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" returned: 0 in 0.460s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Lock "cinder-quobyte-be47dd7c-7d71-49e0-ad43-9a6796ee98b8" released by "delete_volume" :: held 1.048s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['c7e401a3-1527-44fd-9953-a5ae33fea794'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:47 devstack cinder-volume[82600]: WARNING cinder.quota [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1428591757 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1428591757, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Created reservations ['be851949-d3c7-4434-b13b-c0ff01615694', 'c6656c87-fb2c-4441-a59a-8aa6efc9b8e4', '96b6dc13-9518-4d72-9e53-2c2da3ae7ba1', 'fe92f6d0-7a90-4e10-bd6e-fc01d083cafc'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:47 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" returned: 0 in 0.550s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" released by "_copy_volume_from_snapshot" :: held 4.829s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:47 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-f0b675b3-626d-434f-b3fe-7e19b45437cd-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" released by "_create_volume_from_snapshot" :: held 4.853s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:47 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.892s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1050656378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=777360e7-3b9d-4dba-ba32-20d074b5e1c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3b119c31eb447bb068c80a6f30bc08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:47Z,use_quota=True,user_id='991719c235e449429e995a83c8238923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Creating volume 777360e7-3b9d-4dba-ba32-20d074b5e1c0 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:47 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:47 devstack sudo[87429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 1073741824 Apr 15 10:10:47 devstack sudo[87429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (854e55e8-e9b5-4228-a51b-3e34cd1d0f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5', 'volume_size': 1, 'snapshot_id': 'f0b675b3-626d-434f-b3fe-7e19b45437cd'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed07920-e858-40a1-a756-ba0e16123c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:48 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Volume volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 (2704a9ec-5147-4199-bc6b-a5ac4a1c69d5): created successfully Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed07920-e858-40a1-a756-ba0e16123c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Flow 'volume_create_manager' (aa802c30-4dd6-4e50-b214-44e37fa0ecea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:48 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a13d41fa-7cab-4f10-b215-8d4471e4c8d6 tempest-VolumesDeleteCascade-437312007 None] Created volume successfully. Apr 15 10:10:48 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.490s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:48 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a805ecf4-7514-4188-b9ef-e0bada71bd42 tempest-GroupSnapshotsTest-1483548353 None] Delete group completed successfully. Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-27594d27-9168-4169-977f-8d1e460f6e50-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:48 devstack sudo[87429]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 1073741824" returned: 0 in 0.613s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-27594d27-9168-4169-977f-8d1e460f6e50-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Performing cascade delete. {{(pid=82600) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 15 10:10:48 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 Apr 15 10:10:48 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-f0b675b3-626d-434f-b3fe-7e19b45437cd-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-f0b675b3-626d-434f-b3fe-7e19b45437cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-27594d27-9168-4169-977f-8d1e460f6e50" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-27594d27-9168-4169-977f-8d1e460f6e50" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-f0b675b3-626d-434f-b3fe-7e19b45437cd" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-f0b675b3-626d-434f-b3fe-7e19b45437cd" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Deleting offline snapshot f0b675b3-626d-434f-b3fe-7e19b45437cd of volume 27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] snapshot_file for this snap is: volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba7a57c-7b65-494a-9e60-992fc93ac6d4]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:48 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd Apr 15 10:10:48 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:49 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0" returned: 0 in 0.526s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6805aa6-2f82-41bd-93da-b3a186b58af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a7a437-7503-43b7-9a70-462378359941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:49 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Volume volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 (777360e7-3b9d-4dba-ba32-20d074b5e1c0): created successfully Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a7a437-7503-43b7-9a70-462378359941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Flow 'volume_create_manager' (f94412c1-c226-4e35-ae64-8e278fee1c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:49 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-744a45a7-8ab6-44d9-9245-0eec78a7c11c tempest-VolumesActionsTest-1899341244 None] Created volume successfully. Apr 15 10:10:49 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd" returned: 0 in 0.682s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27594d27-9168-4169-977f-8d1e460f6e50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e3a691-9dbd-4f0b-a6ee-0c3452d93fbd]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:49 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 Apr 15 10:10:49 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:50 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50" returned: 0 in 0.602s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:50 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd Apr 15 10:10:50 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "cinder-777360e7-3b9d-4dba-ba32-20d074b5e1c0-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-777360e7-3b9d-4dba-ba32-20d074b5e1c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:50 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd" returned: 0 in 0.712s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "cinder-quobyte-777360e7-3b9d-4dba-ba32-20d074b5e1c0" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:50 devstack sudo[87459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd Apr 15 10:10:50 devstack sudo[87459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-quobyte-777360e7-3b9d-4dba-ba32-20d074b5e1c0" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[215a4311-541b-42f2-91c7-ed19b760205d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:50 devstack sudo[87461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 Apr 15 10:10:50 devstack sudo[87461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:51 devstack sudo[87459]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50.f0b675b3-626d-434f-b3fe-7e19b45437cd" returned: 0 in 0.554s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-f0b675b3-626d-434f-b3fe-7e19b45437cd" released by "_delete_snapshot" :: held 2.606s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-27594d27-9168-4169-977f-8d1e460f6e50" released by "delete_snapshot" :: held 2.625s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Created reservations ['6028992a-619f-4441-a6cb-2d07e3fdd1b7', '9061f666-ef43-416b-bbce-2556b1d01ee7', '3fd531e0-7a69-4728-a1b4-03b3d6328a73', '5456be94-6b92-4cd8-9132-6032f6aba7c9'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Delete snapshot completed successfully. Apr 15 10:10:51 devstack sudo[87461]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-f0b675b3-626d-434f-b3fe-7e19b45437cd-delete_snapshot" released by "delete_snapshot" :: held 2.768s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Snapshots deleted, issuing volume delete {{(pid=82600) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-27594d27-9168-4169-977f-8d1e460f6e50" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0" returned: 0 in 0.634s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-27594d27-9168-4169-977f-8d1e460f6e50" acquired by "delete_volume" :: waited 0.023s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:51 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0 Apr 15 10:10:51 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8713e282-b801-4f02-8393-cd8e18b895e4]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:51 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 Apr 15 10:10:51 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:51 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-777360e7-3b9d-4dba-ba32-20d074b5e1c0" returned: 0 in 0.515s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-quobyte-777360e7-3b9d-4dba-ba32-20d074b5e1c0" released by "delete_volume" :: held 1.186s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:51 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Created reservations ['69676c88-cb0e-4e5d-bd0d-344d2437aec2', '4ebbb853-a316-4726-ab5e-48f4905ce62f', 'b2325b1c-1ccd-4ab4-a3fb-0a2a7fc0887e', '9310d46a-9b50-4419-944a-3b97e555d118'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:52 devstack sudo[87476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:52 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:52 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50" returned: 0 in 0.691s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:52 devstack sudo[87478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50 Apr 15 10:10:52 devstack sudo[87478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:52 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.526s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:52 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Deleted volume successfully. Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05b6c50e-d19e-4b91-8c79-8e966dc78cb8 tempest-VolumesActionsTest-1899341244 None] Lock "cinder-777360e7-3b9d-4dba-ba32-20d074b5e1c0-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:52 devstack sudo[87478]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-27594d27-9168-4169-977f-8d1e460f6e50" returned: 0 in 0.476s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-27594d27-9168-4169-977f-8d1e460f6e50" released by "delete_volume" :: held 1.209s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Created reservations ['e0f688f2-9215-4706-bc03-41fd2c4d3ea2', 'cd045516-1e6d-447a-acd6-b11609040c3b', '53640698-c0df-4fbf-ab5d-eaadac32737a', '3f088a43-b647-4980-981a-fe43aecc0915'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:52 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:52 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:52 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8ee253a5-21e6-470a-a0f4-65db64266f9d tempest-GroupSnapshotsV319Test-1161664806 None] Group tempest-GroupSnapshotsV319Test-Group-1760691630: creating Apr 15 10:10:52 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8ee253a5-21e6-470a-a0f4-65db64266f9d tempest-GroupSnapshotsV319Test-1161664806 None] Group tempest-GroupSnapshotsV319Test-Group-1760691630: created successfully Apr 15 10:10:52 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8ee253a5-21e6-470a-a0f4-65db64266f9d tempest-GroupSnapshotsV319Test-1161664806 None] Create group completed successfully. Apr 15 10:10:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "cinder-quobyte-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[823ea3d1-8dfc-4bf9-85f6-1abd361c356f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:53 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 Apr 15 10:10:53 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:53 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.579s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:53 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Deleted volume successfully. Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-10867e9c-e4aa-4277-9899-852775acef63 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-27594d27-9168-4169-977f-8d1e460f6e50-delete_volume" released by "delete_volume" :: held 4.763s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:53 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" returned: 0 in 0.583s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:53 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5 Apr 15 10:10:53 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:54 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" returned: 0 in 0.540s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-quobyte-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5" released by "delete_volume" :: held 1.155s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Flow 'volume_create_manager' (2051cd02-106d-4bd0-8ced-8402b957d5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824e5816-ca6a-4df7-928d-147f75c6fa28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Created reservations ['6b66df41-3ed9-4c1d-82ef-c0604e66ea79', '33f70396-1437-4d22-854a-f0b7d6e5af65', '4ce70166-419e-4493-959f-43fd81d52ba1', 'a87547fd-be26-4b4d-876d-530ab0d1e56e'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824e5816-ca6a-4df7-928d-147f75c6fa28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1299060965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d40acc74-fe17-486f-9d61-0d05ba5d9541,host='devstack@QuobyteHD#QuobyteHD',id=7b12234f-578f-43d7-8c1f-193d7301fd1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1724596d12bb4e428f2e306c58b8bbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:54Z,use_quota=True,user_id='48e0caacfe8746c6966886dbf5049210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8a358b0-0667-4e44-b8f7-214b02783f27),volume_type_id=d8a358b0-0667-4e44-b8f7-214b02783f27)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c1077d-260a-4463-89c3-36c2393b78eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78c1077d-260a-4463-89c3-36c2393b78eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326faaa4-7d71-45f2-9adb-4c50265f5fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326faaa4-7d71-45f2-9adb-4c50265f5fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b12234f-578f-43d7-8c1f-193d7301fd1f', 'volume_name': 'volume-7b12234f-578f-43d7-8c1f-193d7301fd1f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea13f36-9480-453d-ad60-762e0475db67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea13f36-9480-453d-ad60-762e0475db67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6a2b92-0701-4e27-a11b-6f8bd14b1649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:54 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Volume 7b12234f-578f-43d7-8c1f-193d7301fd1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b12234f-578f-43d7-8c1f-193d7301fd1f', 'volume_size': 1} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d40acc74-fe17-486f-9d61-0d05ba5d9541,created_at=2026-04-15T08:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1299060965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d40acc74-fe17-486f-9d61-0d05ba5d9541,host='devstack@QuobyteHD#QuobyteHD',id=7b12234f-578f-43d7-8c1f-193d7301fd1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1724596d12bb4e428f2e306c58b8bbb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:54Z,use_quota=True,user_id='48e0caacfe8746c6966886dbf5049210',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8a358b0-0667-4e44-b8f7-214b02783f27),volume_type_id=d8a358b0-0667-4e44-b8f7-214b02783f27)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Creating volume 7b12234f-578f-43d7-8c1f-193d7301fd1f {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:10:54 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:54 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f 1073741824 Apr 15 10:10:54 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:54 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:10:54 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:54 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f 1073741824" returned: 0 in 0.571s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:54 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.503s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:10:54 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Deleted volume successfully. Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1512a20a-18fb-4a3b-8685-948bf39ff009 tempest-VolumesDeleteCascade-437312007 None] Lock "cinder-2704a9ec-5147-4199-bc6b-a5ac4a1c69d5-delete_volume" released by "delete_volume" :: held 1.985s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:10:55 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f Apr 15 10:10:55 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:55 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f" returned: 0 in 0.592s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:10:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:10:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de6a2b92-0701-4e27-a11b-6f8bd14b1649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b12234f-578f-43d7-8c1f-193d7301fd1f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1238661a-1952-4a41-adaf-f7ac5e7c76e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:55 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Volume volume-7b12234f-578f-43d7-8c1f-193d7301fd1f (7b12234f-578f-43d7-8c1f-193d7301fd1f): created successfully Apr 15 10:10:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1238661a-1952-4a41-adaf-f7ac5e7c76e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Flow 'volume_create_manager' (2051cd02-106d-4bd0-8ced-8402b957d5a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:55 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f773a51e-2b4e-44e4-9336-2120b51ba06c tempest-GroupSnapshotsV319Test-1161664806 None] Created volume successfully. Apr 15 10:10:56 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] GroupSnapshot 3c8500d4-f5f8-4fa9-a47b-24574183d8c7: creating. Apr 15 10:10:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Group snapshot 3c8500d4-f5f8-4fa9-a47b-24574183d8c7: creating. {{(pid=82600) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 15 10:10:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:10:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Creating offline snapshot ac87fe76-922e-48fa-af34-6700c92f2466 of volume 7b12234f-578f-43d7-8c1f-193d7301fd1f {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:10:56 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d354309c-b0a0-43a0-8755-acea439b99f1]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:10:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:56 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f Apr 15 10:10:56 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:57 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f" returned: 0 in 0.651s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:57 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 1G Apr 15 10:10:57 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Flow 'volume_create_manager' (9241d3c9-9a3d-4c6b-ba4a-4ca0cd5d013b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74064823-fe3a-4f66-ae07-2210db7c0ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74064823-fe3a-4f66-ae07-2210db7c0ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1994132617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f183bd-89c7-43f7-a4bd-f1d9e69eff79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06161cfa16ac4469ab2423790745fec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:58Z,use_quota=True,user_id='ca9e0d1cc18640979a1b9b334f0bafc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a9f03c-e646-4671-963e-628ff75a8731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a9f03c-e646-4671-963e-628ff75a8731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cace77e0-9992-41ec-83ac-80d76f9b17d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cace77e0-9992-41ec-83ac-80d76f9b17d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33f183bd-89c7-43f7-a4bd-f1d9e69eff79', 'volume_name': 'volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec2eb95-d905-4c7d-b18f-a8f91f049179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec2eb95-d905-4c7d-b18f-a8f91f049179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6079be-3fc5-448f-a96d-75ced0e54ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:10:57 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Volume 33f183bd-89c7-43f7-a4bd-f1d9e69eff79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79', 'volume_size': 1} Apr 15 10:10:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:10:58 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 1G" returned: 0 in 0.704s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b12234f-578f-43d7-8c1f-193d7301fd1f -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:58 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b12234f-578f-43d7-8c1f-193d7301fd1f -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 Apr 15 10:10:58 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:58 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b12234f-578f-43d7-8c1f-193d7301fd1f -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466" returned: 0 in 0.561s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:58 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:58 devstack sudo[87523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 Apr 15 10:10:58 devstack sudo[87523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:59 devstack sudo[87523]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466" returned: 0 in 0.536s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:59 devstack sudo[87526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.info Apr 15 10:10:59 devstack sudo[87526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:10:59 devstack sudo[87526]: pam_unix(sudo:session): session closed for user root Apr 15 10:10:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.info" returned: 0 in 0.531s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:10:59 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 15 10:10:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:10:59 devstack sudo[87562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.info Apr 15 10:10:59 devstack sudo[87562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:00 devstack sudo[87562]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.info" returned: 0 in 0.571s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.631s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.485s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1994132617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33f183bd-89c7-43f7-a4bd-f1d9e69eff79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06161cfa16ac4469ab2423790745fec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:10:58Z,use_quota=True,user_id='ca9e0d1cc18640979a1b9b334f0bafc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Creating volume 33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:00 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:00 devstack sudo[87567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 1073741824 Apr 15 10:11:00 devstack sudo[87567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-50996ea9-9789-4047-8f2b-6715a58981b2 tempest-GroupSnapshotsV319Test-1161664806 None] group_snapshot 3c8500d4-f5f8-4fa9-a47b-24574183d8c7: created successfully Apr 15 10:11:01 devstack sudo[87567]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 1073741824" returned: 0 in 0.699s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:01 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 Apr 15 10:11:01 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:01 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] group_snapshot 3c8500d4-f5f8-4fa9-a47b-24574183d8c7: deleting Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] group_snapshot 3c8500d4-f5f8-4fa9-a47b-24574183d8c7: deleting {{(pid=82600) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Acquiring lock "cinder-quobyte-7b12234f-578f-43d7-8c1f-193d7301fd1f" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Lock "cinder-quobyte-7b12234f-578f-43d7-8c1f-193d7301fd1f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Acquiring lock "cinder-quobyte-ac87fe76-922e-48fa-af34-6700c92f2466" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Lock "cinder-quobyte-ac87fe76-922e-48fa-af34-6700c92f2466" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Deleting offline snapshot ac87fe76-922e-48fa-af34-6700c92f2466 of volume 7b12234f-578f-43d7-8c1f-193d7301fd1f {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] snapshot_file for this snap is: volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4dad89-c7ec-476d-b6ea-b1d9da101110]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:01 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 Apr 15 10:11:01 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:01 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" returned: 0 in 0.687s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b6079be-3fc5-448f-a96d-75ced0e54ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bde9d1-32d9-4e1f-b541-6f1ab6b84190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:01 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Volume volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 (33f183bd-89c7-43f7-a4bd-f1d9e69eff79): created successfully Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bde9d1-32d9-4e1f-b541-6f1ab6b84190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Flow 'volume_create_manager' (9241d3c9-9a3d-4c6b-ba4a-4ca0cd5d013b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:01 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-916fabad-31a1-455d-9d5e-e045e3cadcdd tempest-VolumesCloneTest-1778354066 None] Created volume successfully. Apr 15 10:11:02 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466" returned: 0 in 0.630s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b12234f-578f-43d7-8c1f-193d7301fd1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7f6889-3d19-42c2-8b73-b695db64eacc]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:02 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f Apr 15 10:11:02 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Flow 'volume_create_manager' (4f741346-a33a-4a82-a623-2e4cdbe72c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff899c0-3d91-4caa-9676-583a444b5066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ff899c0-3d91-4caa-9676-583a444b5066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-133215948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f870e1a-4878-4d29-a7ba-d892eb59bb00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06161cfa16ac4469ab2423790745fec5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=33f183bd-89c7-43f7-a4bd-f1d9e69eff79,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:02Z,use_quota=True,user_id='ca9e0d1cc18640979a1b9b334f0bafc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5449e925-26b6-4c33-9c28-832e36110871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5449e925-26b6-4c33-9c28-832e36110871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87791e2a-1805-4a97-96e9-4b41052374cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87791e2a-1805-4a97-96e9-4b41052374cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1f870e1a-4878-4d29-a7ba-d892eb59bb00', 'volume_name': 'volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00', 'volume_size': 2, 'source_volid': '33f183bd-89c7-43f7-a4bd-f1d9e69eff79', 'source_volstatus': 'available'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9380e9-69ee-44ab-b43f-e74c76ca251d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9380e9-69ee-44ab-b43f-e74c76ca251d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de23fa2e-677e-46e1-8b28-91236727a1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:02 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Volume 1f870e1a-4878-4d29-a7ba-d892eb59bb00: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00', 'volume_size': 2, 'source_volid': '33f183bd-89c7-43f7-a4bd-f1d9e69eff79', 'source_volstatus': 'available'} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:02 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Cloning volume 33f183bd-89c7-43f7-a4bd-f1d9e69eff79 to volume 1f870e1a-4878-4d29-a7ba-d892eb59bb00 Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Creating offline snapshot 3a3151f1-ecc9-402b-86ce-9aef741758ee of volume 33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db91de6-c1a3-4b9c-927d-26f69b5bc15f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:02 devstack sudo[87585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 Apr 15 10:11:02 devstack sudo[87585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:02 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f" returned: 0 in 0.627s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:02 devstack sudo[87588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 Apr 15 10:11:02 devstack sudo[87588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:03 devstack sudo[87585]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" returned: 0 in 0.658s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:03 devstack sudo[87596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee 1G Apr 15 10:11:03 devstack sudo[87596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:03 devstack sudo[87588]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466" returned: 0 in 0.662s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:03 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466 Apr 15 10:11:03 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:03 devstack sudo[87596]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee 1G" returned: 0 in 0.672s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:03 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:03 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee Apr 15 10:11:03 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f.ac87fe76-922e-48fa-af34-6700c92f2466" returned: 0 in 0.587s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Lock "cinder-quobyte-ac87fe76-922e-48fa-af34-6700c92f2466" released by "_delete_snapshot" :: held 2.594s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Lock "cinder-quobyte-7b12234f-578f-43d7-8c1f-193d7301fd1f" released by "delete_snapshot" :: held 2.612s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:04 devstack cinder-volume[82600]: WARNING cinder.quota [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1206750568 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1206750568, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:04 devstack cinder-volume[82600]: WARNING cinder.quota [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1206750568 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1206750568, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] Created reservations ['a8230779-4de5-4ff5-8e7d-786cdb2959c7', '058e1193-66a0-4998-90db-1cf8024371bc', '7bdf571e-4a3d-440d-bec8-4d98cffdc6d4', '109973c6-8216-4743-bf3b-2119c3795882'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b5e2317e-0439-45c6-8e7f-349bfd03a9fb tempest-GroupSnapshotsV319Test-1161664806 None] group_snapshot 3c8500d4-f5f8-4fa9-a47b-24574183d8c7: deleted successfully Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Flow 'volume_create_manager' (1cdfd6eb-a1b2-4171-888b-0ea2eb28db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145b5285-f285-44d2-8d4d-c0c88ec1ee0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (145b5285-f285-44d2-8d4d-c0c88ec1ee0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-706449125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfd759920b7437ea549f2baa591eba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:05Z,use_quota=True,user_id='48020f7938364163bfd369a3b79e3710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30686f0d-843f-4bf1-81a6-a33315b6e70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30686f0d-843f-4bf1-81a6-a33315b6e70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:04 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09507ce-037f-4738-8c80-059de1985184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f09507ce-037f-4738-8c80-059de1985184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5', 'volume_name': 'volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9372b8-581f-4f9f-9ed0-f23e52324e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a9372b8-581f-4f9f-9ed0-f23e52324e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94669a96-36db-4242-b508-8a5419a8fbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:04 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Volume b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5', 'volume_size': 1} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee" returned: 0 in 0.669s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:04 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee is being set with open permissions: ugo+rw Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:04 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee Apr 15 10:11:04 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Acquiring lock "cinder-quobyte-7b12234f-578f-43d7-8c1f-193d7301fd1f" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Lock "cinder-quobyte-7b12234f-578f-43d7-8c1f-193d7301fd1f" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0534d5-84ea-48fe-8d4f-5d7861c9867d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:04 devstack sudo[87611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f Apr 15 10:11:04 devstack sudo[87611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee" returned: 0 in 0.458s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:05 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.info Apr 15 10:11:05 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[87611]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:05 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f Apr 15 10:11:05 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.info" returned: 0 in 0.504s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.info is being set with open permissions: ugo+rw Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:05 devstack sudo[87622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.info Apr 15 10:11:05 devstack sudo[87622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:05 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7b12234f-578f-43d7-8c1f-193d7301fd1f" returned: 0 in 0.481s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Lock "cinder-quobyte-7b12234f-578f-43d7-8c1f-193d7301fd1f" released by "delete_volume" :: held 1.061s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Created reservations ['6af858c7-29d3-4c79-9af9-7a45f569da66'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:05 devstack cinder-volume[82600]: WARNING cinder.quota [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1206750568 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1206750568, it is now deprecated. Please use the default quota class for default quota. Apr 15 10:11:05 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Created reservations ['afe38561-cfda-4d8d-b344-f4e3f17704c4', '97108b41-cba2-435b-bcb5-de2ed7405b65', '1dd46979-6bc8-4dfd-94fa-ee14baff5fb6', 'f1fbb02d-2f54-4c71-aa7d-2b1fb05f5246'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:06 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:06 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:06 devstack sudo[87622]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.info" returned: 0 in 0.466s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Acquiring lock "cinder-quobyte-1f870e1a-4878-4d29-a7ba-d892eb59bb00" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Lock "cinder-quobyte-1f870e1a-4878-4d29-a7ba-d892eb59bb00" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] snapshot: 3a3151f1-ecc9-402b-86ce-9aef741758ee, volume: 1f870e1a-4878-4d29-a7ba-d892eb59bb00, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae71b5e-5aad-4146-ae81-2877de0d091a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:06 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee Apr 15 10:11:06 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:06 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.462s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:06 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-16846bb0-74be-4cb7-9844-5a5dfeb20248 tempest-GroupSnapshotsV319Test-1161664806 None] Delete group completed successfully. Apr 15 10:11:06 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee" returned: 0 in 0.541s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03b43a4-aeb7-455d-b487-5dec47224a91]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:06 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 Apr 15 10:11:06 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:07 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" returned: 0 in 0.545s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:07 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:11:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:07 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 Apr 15 10:11:07 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:09 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00" returned: 0 in 2.423s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:09 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[47643ad6-cd67-47fc-bc1b-f63cb04a811c]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:09 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 Apr 15 10:11:09 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:10 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:10 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:10 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" returned: 0 in 0.705s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:11:10 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Converted 1024.00 MB image at 422.34 MB/s Apr 15 10:11:10 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 is being set with open permissions: ugo+rw Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:10 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 Apr 15 10:11:10 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:10 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.601s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:10 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00" returned: 0 in 0.479s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Lock "cinder-quobyte-1f870e1a-4878-4d29-a7ba-d892eb59bb00" released by "_copy_volume_from_snapshot" :: held 4.746s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=184,cinder:UPDATE=213,cinder:DELETE=18,cinder:INSERT=56 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Acquiring lock "cinder-quobyte-3a3151f1-ecc9-402b-86ce-9aef741758ee" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Lock "cinder-quobyte-3a3151f1-ecc9-402b-86ce-9aef741758ee" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Deleting offline snapshot 3a3151f1-ecc9-402b-86ce-9aef741758ee of volume 33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] snapshot_file for this snap is: volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[423025f9-b38f-47ea-a0f0-451c9402fa6f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:10 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee Apr 15 10:11:10 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:11 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee" returned: 0 in 0.574s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc45430-1479-4fe5-8cb4-af95c1ef654e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:11 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 Apr 15 10:11:11 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:12 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" returned: 0 in 0.607s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:12 devstack sudo[87673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee Apr 15 10:11:12 devstack sudo[87673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:12 devstack sudo[87673]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee" returned: 0 in 0.566s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:12 devstack sudo[87678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee Apr 15 10:11:12 devstack sudo[87678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:13 devstack sudo[87678]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79.3a3151f1-ecc9-402b-86ce-9aef741758ee" returned: 0 in 0.478s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Lock "cinder-quobyte-3a3151f1-ecc9-402b-86ce-9aef741758ee" released by "_delete_snapshot" :: held 2.285s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.601s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.563s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-706449125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edfd759920b7437ea549f2baa591eba9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:05Z,use_quota=True,user_id='48020f7938364163bfd369a3b79e3710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Creating volume b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:13 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de23fa2e-677e-46e1-8b28-91236727a1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00', 'volume_size': 2, 'source_volid': '33f183bd-89c7-43f7-a4bd-f1d9e69eff79', 'source_volstatus': 'available'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:13 devstack sudo[87681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 1073741824 Apr 15 10:11:13 devstack sudo[87681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609bcca4-8a7e-421f-8721-21c7f30d1f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:13 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Volume volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 (1f870e1a-4878-4d29-a7ba-d892eb59bb00): created successfully Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609bcca4-8a7e-421f-8721-21c7f30d1f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Flow 'volume_create_manager' (4f741346-a33a-4a82-a623-2e4cdbe72c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-5c15ef06-c292-4441-abfa-0425ad9ccda0 tempest-VolumesCloneTest-1778354066 None] Created volume successfully. Apr 15 10:11:13 devstack sudo[87681]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 1073741824" returned: 0 in 0.594s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:13 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 Apr 15 10:11:13 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:14 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5" returned: 0 in 0.479s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94669a96-36db-4242-b508-8a5419a8fbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a245571-15b1-49c4-8169-defa07de0523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:14 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Volume volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 (b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5): created successfully Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a245571-15b1-49c4-8169-defa07de0523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Flow 'volume_create_manager' (1cdfd6eb-a1b2-4171-888b-0ea2eb28db1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:14 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ccb90e94-b053-48d0-a26f-de2174a87459 tempest-VolumesMetadataTest-1764553507 None] Created volume successfully. Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Acquiring lock "cinder-1f870e1a-4878-4d29-a7ba-d892eb59bb00-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Lock "cinder-1f870e1a-4878-4d29-a7ba-d892eb59bb00-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Acquiring lock "cinder-quobyte-1f870e1a-4878-4d29-a7ba-d892eb59bb00" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Lock "cinder-quobyte-1f870e1a-4878-4d29-a7ba-d892eb59bb00" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9551d37e-b286-42ed-8011-122399a0b8f2]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:14 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 Apr 15 10:11:14 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:15 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00" returned: 0 in 0.596s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:15 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00 Apr 15 10:11:15 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:15 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-1f870e1a-4878-4d29-a7ba-d892eb59bb00" returned: 0 in 0.487s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Lock "cinder-quobyte-1f870e1a-4878-4d29-a7ba-d892eb59bb00" released by "delete_volume" :: held 1.122s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Created reservations ['c4d84403-d533-44cc-9d81-36ab18ebb605', 'f547b311-6497-4012-8087-efd233787c87', 'c2991135-2715-4092-8cd1-9f58315a927e', 'a8bda82f-959e-4815-b68b-c365ac893477'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:15 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:15 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Acquiring lock "cinder-33f183bd-89c7-43f7-a4bd-f1d9e69eff79-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Lock "cinder-33f183bd-89c7-43f7-a4bd-f1d9e69eff79-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Acquiring lock "cinder-quobyte-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Lock "cinder-quobyte-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" acquired by "delete_volume" :: waited 0.022s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2018a0-b832-4b23-86de-2553978a4176]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Acquiring lock "cinder-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Lock "cinder-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Acquiring lock "cinder-quobyte-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Lock "cinder-quobyte-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0af9020-cda9-4aed-b55d-b348942b4e26]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:16 devstack sudo[87699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 Apr 15 10:11:16 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:16 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 Apr 15 10:11:16 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:16 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.558s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:16 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Deleted volume successfully. Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8e52bf4f-b137-4c73-a6ad-3421794dae3a tempest-VolumesCloneTest-1778354066 None] Lock "cinder-1f870e1a-4878-4d29-a7ba-d892eb59bb00-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:16 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" returned: 0 in 0.666s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:16 devstack sudo[87711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79 Apr 15 10:11:16 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:16 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5" returned: 0 in 0.639s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:16 devstack sudo[87713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5 Apr 15 10:11:16 devstack sudo[87713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:17 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" returned: 0 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Lock "cinder-quobyte-33f183bd-89c7-43f7-a4bd-f1d9e69eff79" released by "delete_volume" :: held 1.246s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Created reservations ['08f2e38a-a5ea-4e68-a935-8ff543ce6b7f', '0e511524-22af-486b-9dd1-22e47a2b6bf4', 'b1f50d6f-1516-48b9-bf38-ad8cd9b76ad1', 'f05c077b-3e28-4478-93a3-e39a31fd76db'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:17 devstack sudo[87713]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Lock "cinder-quobyte-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5" released by "delete_volume" :: held 1.211s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:17 devstack sudo[87717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:17 devstack sudo[87717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Created reservations ['7d2d8220-f0c0-42c1-93de-dcf3f5ac11ab', 'a90816b4-abde-4e56-ae21-5e2eea7c097e', '2d87d3f1-22af-48ee-8b94-5ba380630175', 'df51cc7d-162d-401d-9c93-0d78d01811c5'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:17 devstack sudo[87719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:17 devstack sudo[87719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:17 devstack sudo[87717]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.468s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:17 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Deleted volume successfully. Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1fe5c6e3-e2d9-4c6c-8606-1809cc4c03ff tempest-VolumesCloneTest-1778354066 None] Lock "cinder-33f183bd-89c7-43f7-a4bd-f1d9e69eff79-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:17 devstack sudo[87719]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.556s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:17 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Deleted volume successfully. Apr 15 10:11:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f76476fb-f2d8-47cf-bffc-521224cf65a9 tempest-VolumesMetadataTest-1764553507 None] Lock "cinder-b29a7ac2-27f5-40b7-acbf-6a637ec1ccd5-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=216,cinder:UPDATE=261,cinder:INSERT=64,cinder:DELETE=10 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Flow 'volume_create_manager' (5d3884b0-0eb9-45a3-b5cd-c81f974a917e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76b2baa-d886-482b-b5fb-ad0b587412a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76b2baa-d886-482b-b5fb-ad0b587412a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-801807546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e3ac32-f207-4a2f-95cf-a194af885616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f584ed227d3d4d67a46f283faedccc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:22Z,use_quota=True,user_id='e09f07e942c34ef0951393634e35f953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d39a2a9-7ad6-44a6-b6f0-f959a2bd1a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d39a2a9-7ad6-44a6-b6f0-f959a2bd1a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b45a463-bf40-44a8-84bb-831a0bb5c8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b45a463-bf40-44a8-84bb-831a0bb5c8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e3ac32-f207-4a2f-95cf-a194af885616', 'volume_name': 'volume-75e3ac32-f207-4a2f-95cf-a194af885616', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5a1b28-ecd6-4309-9d87-89b7b7a51ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a5a1b28-ecd6-4309-9d87-89b7b7a51ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b85733a-5583-4270-8b1e-cd9d323c7393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:21 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Volume 75e3ac32-f207-4a2f-95cf-a194af885616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e3ac32-f207-4a2f-95cf-a194af885616', 'volume_size': 1} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-801807546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e3ac32-f207-4a2f-95cf-a194af885616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f584ed227d3d4d67a46f283faedccc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:22Z,use_quota=True,user_id='e09f07e942c34ef0951393634e35f953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Creating volume 75e3ac32-f207-4a2f-95cf-a194af885616 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:21 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:21 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616 1073741824 Apr 15 10:11:21 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:22 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616 1073741824" returned: 0 in 0.622s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:22 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616 Apr 15 10:11:22 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Flow 'volume_create_manager' (a09ea6e2-af5d-4eef-b5f3-f4ba62fa6299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f840962c-3f96-4dd8-9c50-f9e8b8d9d9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f840962c-3f96-4dd8-9c50-f9e8b8d9d9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1771285253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79873bcd-3876-4f07-91f9-a1acea1f4c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea938af93a49453e85c1f579fb9f3a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:23Z,use_quota=True,user_id='337a4148dd114e3a9704e4d0b1076b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f62e7e5-2bd3-45d5-b22a-d1d85499ddf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f62e7e5-2bd3-45d5-b22a-d1d85499ddf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4354a2a2-494a-4cda-9496-4e0f1f1e29dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4354a2a2-494a-4cda-9496-4e0f1f1e29dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79873bcd-3876-4f07-91f9-a1acea1f4c26', 'volume_name': 'volume-79873bcd-3876-4f07-91f9-a1acea1f4c26', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b68464-899f-4126-8b6f-a9592fb438f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b68464-899f-4126-8b6f-a9592fb438f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71a948a-f8aa-4f86-95c8-c8ca9610c4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:22 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Volume 79873bcd-3876-4f07-91f9-a1acea1f4c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79873bcd-3876-4f07-91f9-a1acea1f4c26', 'volume_size': 1} Apr 15 10:11:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:23 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616" returned: 0 in 0.504s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.229s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1771285253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79873bcd-3876-4f07-91f9-a1acea1f4c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea938af93a49453e85c1f579fb9f3a69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:23Z,use_quota=True,user_id='337a4148dd114e3a9704e4d0b1076b2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Creating volume 79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:23 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b85733a-5583-4270-8b1e-cd9d323c7393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e3ac32-f207-4a2f-95cf-a194af885616', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:23 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 1073741824 Apr 15 10:11:23 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40664e66-6703-4a58-9b80-f5424a4f3d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:23 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Volume volume-75e3ac32-f207-4a2f-95cf-a194af885616 (75e3ac32-f207-4a2f-95cf-a194af885616): created successfully Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40664e66-6703-4a58-9b80-f5424a4f3d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Flow 'volume_create_manager' (5d3884b0-0eb9-45a3-b5cd-c81f974a917e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:23 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e4837d31-e58b-4986-a58b-b8bcabfd8fc4 tempest-VolumesTransfersV355Test-561411070 None] Created volume successfully. Apr 15 10:11:23 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 1073741824" returned: 0 in 0.581s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:23 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 Apr 15 10:11:23 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:24 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26" returned: 0 in 0.504s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e71a948a-f8aa-4f86-95c8-c8ca9610c4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79873bcd-3876-4f07-91f9-a1acea1f4c26', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc7288f-5784-443b-8c0c-2e01d72c584e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:24 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Volume volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 (79873bcd-3876-4f07-91f9-a1acea1f4c26): created successfully Apr 15 10:11:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cc7288f-5784-443b-8c0c-2e01d72c584e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Flow 'volume_create_manager' (a09ea6e2-af5d-4eef-b5f3-f4ba62fa6299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:24 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c5e12017-5394-4863-b3e5-b1dabc27f82e tempest-VolumesSnapshotListTestJSON-1160353498 None] Created volume successfully. Apr 15 10:11:24 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-91980108-478c-4ab9-ba08-e007c963b701 tempest-VolumesTransfersV355Test-618268167 None] Transfer volume completed successfully. Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Creating offline snapshot d371934e-a8a5-4cdc-8a4a-b730fdae9794 of volume 79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa34cf90-fe21-48b5-b99f-208335f9b681]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:25 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 Apr 15 10:11:25 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Acquiring lock "cinder-75e3ac32-f207-4a2f-95cf-a194af885616-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Lock "cinder-75e3ac32-f207-4a2f-95cf-a194af885616-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Acquiring lock "cinder-quobyte-75e3ac32-f207-4a2f-95cf-a194af885616" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Lock "cinder-quobyte-75e3ac32-f207-4a2f-95cf-a194af885616" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b8e2af-ffa9-4023-a883-4aae3f2aebb4]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:25 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616 Apr 15 10:11:25 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:25 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26" returned: 0 in 0.627s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:25 devstack sudo[87747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 1G Apr 15 10:11:25 devstack sudo[87747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616" returned: 0 in 0.548s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:26 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616 Apr 15 10:11:26 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack sudo[87747]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 1G" returned: 0 in 0.590s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:26 devstack sudo[87757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 Apr 15 10:11:26 devstack sudo[87757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75e3ac32-f207-4a2f-95cf-a194af885616" returned: 0 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Lock "cinder-quobyte-75e3ac32-f207-4a2f-95cf-a194af885616" released by "delete_volume" :: held 1.126s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Created reservations ['66835031-92bf-44bd-bb10-36924d8c4669', 'b6353453-050a-4529-bf61-2b2c6f4e2ec7', '1608710f-f4aa-44da-9197-e206e7c785b9', '1e894bbc-ab8b-481e-bcb2-d7784c1d0761'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:26 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:26 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:26 devstack sudo[87757]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794" returned: 0 in 0.562s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:26 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 is being set with open permissions: ugo+rw Apr 15 10:11:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:26 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 Apr 15 10:11:26 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:27 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.500s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:27 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:27 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Deleted volume successfully. Apr 15 10:11:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-39dc1029-bd22-4a87-8c03-bbb19571ad5b tempest-VolumesTransfersV355Test-1682909285 None] Lock "cinder-75e3ac32-f207-4a2f-95cf-a194af885616-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:27 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794" returned: 0 in 0.466s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:27 devstack sudo[87769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.info Apr 15 10:11:27 devstack sudo[87769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:27 devstack sudo[87769]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.info" returned: 0 in 0.497s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:27 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.info is being set with open permissions: ugo+rw Apr 15 10:11:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:27 devstack sudo[87772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.info Apr 15 10:11:27 devstack sudo[87772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Flow 'volume_create_manager' (7b52b114-a689-458e-a2c9-9261957f454a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e12a80c-9a01-4cae-8e6b-24abe8a38e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e12a80c-9a01-4cae-8e6b-24abe8a38e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-834534731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ac5be3-8f8d-422f-98df-fd66c5fa54d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f584ed227d3d4d67a46f283faedccc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:28Z,use_quota=True,user_id='e09f07e942c34ef0951393634e35f953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b99bd3e-00ec-43e3-8816-6be7f0dd24e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b99bd3e-00ec-43e3-8816-6be7f0dd24e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a98b7a-1fcb-47cc-aa52-012feb3056ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28a98b7a-1fcb-47cc-aa52-012feb3056ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3ac5be3-8f8d-422f-98df-fd66c5fa54d9', 'volume_name': 'volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295e2ec2-0a6b-4b5f-bedc-3c509924bca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (295e2ec2-0a6b-4b5f-bedc-3c509924bca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a40aaca-dd63-41f3-a4f4-48c75da92486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:28 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Volume d3ac5be3-8f8d-422f-98df-fd66c5fa54d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9', 'volume_size': 1} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:28 devstack sudo[87772]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.info" returned: 0 in 0.464s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.281s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-834534731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3ac5be3-8f8d-422f-98df-fd66c5fa54d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f584ed227d3d4d67a46f283faedccc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:28Z,use_quota=True,user_id='e09f07e942c34ef0951393634e35f953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Creating volume d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:28 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:28 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 1073741824 Apr 15 10:11:28 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:28 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-9485e1f5-1d80-46e9-9198-c1bbf4175520 tempest-VolumesSnapshotListTestJSON-1160353498 None] Create snapshot completed successfully Apr 15 10:11:28 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 1073741824" returned: 0 in 0.577s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:28 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 Apr 15 10:11:28 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:29 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9" returned: 0 in 0.502s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.104s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Creating offline snapshot 52aff85f-1eb3-4bea-a6c5-11f70dd90178 of volume 79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a40aaca-dd63-41f3-a4f4-48c75da92486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f42cd0-ba55-4e30-b1ef-bade218443e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[80107761-b418-4449-aa95-c5595a1b9a93]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:29 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Volume volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 (d3ac5be3-8f8d-422f-98df-fd66c5fa54d9): created successfully Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1f42cd0-ba55-4e30-b1ef-bade218443e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Flow 'volume_create_manager' (7b52b114-a689-458e-a2c9-9261957f454a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:29 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4902d74f-24c5-4b53-b20e-d7af552e61a0 tempest-VolumesTransfersV355Test-561411070 None] Created volume successfully. Apr 15 10:11:29 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 Apr 15 10:11:29 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794" returned: 0 in 0.561s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79873bcd-3876-4f07-91f9-a1acea1f4c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 1G Apr 15 10:11:30 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Acquiring lock "cinder-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Lock "cinder-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Acquiring lock "cinder-quobyte-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Lock "cinder-quobyte-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0bf894-e3e0-4636-97ed-7d054c439cc7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 Apr 15 10:11:30 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:30 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 1G" returned: 0 in 0.696s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:30 devstack sudo[87795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 Apr 15 10:11:30 devstack sudo[87795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9" returned: 0 in 0.589s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9 Apr 15 10:11:31 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack sudo[87795]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178" returned: 0 in 0.558s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 is being set with open permissions: ugo+rw Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 Apr 15 10:11:31 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Lock "cinder-quobyte-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9" released by "delete_volume" :: held 1.153s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Created reservations ['9b39fc91-6007-4e02-9035-616e0c8b4485', '3e3bcbc8-2738-4ed0-b375-1e20484aff23', 'd1ffc239-c67c-4765-bd8e-dc54b62e8a27', 'b9b27fcd-b181-4cb0-b4d3-92be56ce3d2d'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:31 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:31 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:31 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178" returned: 0 in 0.537s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.426s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:31 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-df038dfb-8c12-4e87-9190-953a00a52437 tempest-VolumesSnapshotListTestJSON-1160353498 None] Create snapshot completed successfully Apr 15 10:11:32 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.494s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:32 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:32 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Deleted volume successfully. Apr 15 10:11:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2a7b2fcf-5845-42ca-a148-2ed6d33878da tempest-VolumesTransfersV355Test-1682909285 None] Lock "cinder-d3ac5be3-8f8d-422f-98df-fd66c5fa54d9-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Creating offline snapshot 0d4cc530-141b-43cc-b09e-8734ec7208f4 of volume 79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:32 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cce9d9-2b73-4e4f-ac4e-b3c8fb149a5e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:32 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 Apr 15 10:11:32 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:33 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178" returned: 0 in 0.628s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79873bcd-3876-4f07-91f9-a1acea1f4c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:33 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 1G Apr 15 10:11:33 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:34 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 1G" returned: 0 in 0.711s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:34 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 Apr 15 10:11:34 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:34 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4" returned: 0 in 0.584s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:34 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 is being set with open permissions: ugo+rw Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:34 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 Apr 15 10:11:34 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Flow 'volume_create_manager' (ed2a83a2-5c15-41b1-b311-8dc44279a8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcd843a-989d-4b76-948c-3a46c945722e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcd843a-989d-4b76-948c-3a46c945722e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1691569806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4a415b-5da2-4059-a542-abc1791cb9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56360a4581374932ac8d9de154250e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:35Z,use_quota=True,user_id='6ea3d1e2006a4884aa06160fcc3b7d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d0d261-8d6d-46c1-be3d-ff2ac1f4f2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d0d261-8d6d-46c1-be3d-ff2ac1f4f2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5d2370-bb42-4db0-9bea-522511ced39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec5d2370-bb42-4db0-9bea-522511ced39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb4a415b-5da2-4059-a542-abc1791cb9bc', 'volume_name': 'volume-eb4a415b-5da2-4059-a542-abc1791cb9bc', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294b6929-34b4-49d0-aeee-7702836b040c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (294b6929-34b4-49d0-aeee-7702836b040c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76252dd8-8620-4836-a97c-2bd62b999769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:34 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Volume eb4a415b-5da2-4059-a542-abc1791cb9bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb4a415b-5da2-4059-a542-abc1791cb9bc', 'volume_size': 1} Apr 15 10:11:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:35 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4" returned: 0 in 0.583s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.611s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1691569806',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb4a415b-5da2-4059-a542-abc1791cb9bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56360a4581374932ac8d9de154250e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:35Z,use_quota=True,user_id='6ea3d1e2006a4884aa06160fcc3b7d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Creating volume eb4a415b-5da2-4059-a542-abc1791cb9bc {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:35 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:35 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6ce01df6-0c90-4135-8a35-259cd2f30258 tempest-VolumesSnapshotListTestJSON-1160353498 None] Create snapshot completed successfully Apr 15 10:11:35 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc 1073741824 Apr 15 10:11:35 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:35 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc 1073741824" returned: 0 in 0.722s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:36 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc Apr 15 10:11:36 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-0d4cc530-141b-43cc-b09e-8734ec7208f4-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-0d4cc530-141b-43cc-b09e-8734ec7208f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-quobyte-0d4cc530-141b-43cc-b09e-8734ec7208f4" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-0d4cc530-141b-43cc-b09e-8734ec7208f4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Deleting offline snapshot 0d4cc530-141b-43cc-b09e-8734ec7208f4 of volume 79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] snapshot_file for this snap is: volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd588965-0f45-4773-a55c-04358c4dd49a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:36 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc" returned: 0 in 0.607s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76252dd8-8620-4836-a97c-2bd62b999769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb4a415b-5da2-4059-a542-abc1791cb9bc', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1d8c7d-ba17-4bfe-98ac-3d02085e7990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Volume volume-eb4a415b-5da2-4059-a542-abc1791cb9bc (eb4a415b-5da2-4059-a542-abc1791cb9bc): created successfully Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a1d8c7d-ba17-4bfe-98ac-3d02085e7990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Flow 'volume_create_manager' (ed2a83a2-5c15-41b1-b311-8dc44279a8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:36 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6a2588ef-96a5-4a39-84ad-6c10625b04bc tempest-VolumesListAdminTestJSON-841972361 None] Created volume successfully. Apr 15 10:11:36 devstack sudo[87841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 Apr 15 10:11:36 devstack sudo[87841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Flow 'volume_create_manager' (6b464f75-f38c-4932-8564-14872d4001b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374af905-01cd-4643-91a9-c6a9b3c4d4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (374af905-01cd-4643-91a9-c6a9b3c4d4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-880468426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5470490-c7fd-4186-921d-b8d6ead9f11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27229d74b682428789324fb6f194cc3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:37Z,use_quota=True,user_id='7995fbdb9d7b454ab4b5e230f7360379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a1adb8-9bb5-477d-b059-5f24127c9510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a1adb8-9bb5-477d-b059-5f24127c9510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a2a2ca-24bc-4310-a43d-f9fb8c3de68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a2a2ca-24bc-4310-a43d-f9fb8c3de68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5470490-c7fd-4186-921d-b8d6ead9f11a', 'volume_name': 'volume-f5470490-c7fd-4186-921d-b8d6ead9f11a', 'volume_size': 2}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc92ffb-1d9c-4b71-9e4a-62181190fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc92ffb-1d9c-4b71-9e4a-62181190fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65618688-2ef2-4fe4-b1c3-578a91fa47cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:36 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Volume f5470490-c7fd-4186-921d-b8d6ead9f11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5470490-c7fd-4186-921d-b8d6ead9f11a', 'volume_size': 2} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-880468426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5470490-c7fd-4186-921d-b8d6ead9f11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27229d74b682428789324fb6f194cc3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:37Z,use_quota=True,user_id='7995fbdb9d7b454ab4b5e230f7360379',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Creating volume f5470490-c7fd-4186-921d-b8d6ead9f11a {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:36 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a 2147483648 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:36 devstack sudo[87843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a 2147483648 Apr 15 10:11:36 devstack sudo[87843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Flow 'volume_create_manager' (d16cd740-a0f4-4329-a7ef-15a6bf14c60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b706b9a5-76d1-4120-a316-53097424dffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b706b9a5-76d1-4120-a316-53097424dffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-395223324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec9b664-b9fc-467b-b306-2628bae86a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56360a4581374932ac8d9de154250e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:37Z,use_quota=True,user_id='6ea3d1e2006a4884aa06160fcc3b7d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144c7398-e59a-4cf1-8583-c0d9f22bc91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (144c7398-e59a-4cf1-8583-c0d9f22bc91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:37 devstack sudo[87841]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bf4145-c902-45ad-87fb-a446066a64c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0bf4145-c902-45ad-87fb-a446066a64c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec9b664-b9fc-467b-b306-2628bae86a25', 'volume_name': 'volume-bec9b664-b9fc-467b-b306-2628bae86a25', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdeb7be1-e305-419a-a9eb-10d9405cebe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdeb7be1-e305-419a-a9eb-10d9405cebe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1477db45-46ec-4434-b138-604e87be00bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:37 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Volume bec9b664-b9fc-467b-b306-2628bae86a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec9b664-b9fc-467b-b306-2628bae86a25', 'volume_size': 1} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4" returned: 0 in 0.643s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79873bcd-3876-4f07-91f9-a1acea1f4c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b1d1d1-a0c1-4c21-a9d7-7c1aa1a9921d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:37 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 Apr 15 10:11:37 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:37 devstack sudo[87843]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a 2147483648" returned: 0 in 0.693s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:37 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a Apr 15 10:11:37 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:37 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178" returned: 0 in 0.601s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79873bcd-3876-4f07-91f9-a1acea1f4c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:37 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 Apr 15 10:11:37 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:38 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a" returned: 0 in 0.531s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-395223324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec9b664-b9fc-467b-b306-2628bae86a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56360a4581374932ac8d9de154250e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:37Z,use_quota=True,user_id='6ea3d1e2006a4884aa06160fcc3b7d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Creating volume bec9b664-b9fc-467b-b306-2628bae86a25 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:38 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65618688-2ef2-4fe4-b1c3-578a91fa47cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5470490-c7fd-4186-921d-b8d6ead9f11a', 'volume_size': 2}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69e7b19-d1ea-4919-8491-3bd5e085a7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:38 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25 1073741824 Apr 15 10:11:38 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:38 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Volume volume-f5470490-c7fd-4186-921d-b8d6ead9f11a (f5470490-c7fd-4186-921d-b8d6ead9f11a): created successfully Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69e7b19-d1ea-4919-8491-3bd5e085a7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Flow 'volume_create_manager' (6b464f75-f38c-4932-8564-14872d4001b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:38 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-974391df-b1b9-4f6e-92a3-2f3e4d73f5f1 tempest-VolumesCloneNegativeTest-1083736123 None] Created volume successfully. Apr 15 10:11:38 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4" returned: 0 in 0.568s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:38 devstack sudo[87866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4 Apr 15 10:11:38 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:38 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25 1073741824" returned: 0 in 0.612s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:38 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:38 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25 Apr 15 10:11:38 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.0d4cc530-141b-43cc-b09e-8734ec7208f4" returned: 0 in 0.478s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-0d4cc530-141b-43cc-b09e-8734ec7208f4" released by "_delete_snapshot" :: held 2.353s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" released by "delete_snapshot" :: held 2.369s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Created reservations ['8e9a34e3-038f-4aeb-ac48-465a4a74ebd1', '868eb3e4-7633-4d4c-9418-f0615d4f4543', 'da62f4cc-b84c-47aa-b61c-321e08ff12af', 'aa50c887-f794-4803-b5fd-145545135a73'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:38 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Delete snapshot completed successfully. Apr 15 10:11:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7f82bf94-a1ef-494e-a6f5-1aecce930f34 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-0d4cc530-141b-43cc-b09e-8734ec7208f4-delete_snapshot" released by "delete_snapshot" :: held 2.469s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Acquiring lock "cinder-f5470490-c7fd-4186-921d-b8d6ead9f11a-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "cinder-f5470490-c7fd-4186-921d-b8d6ead9f11a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Acquiring lock "cinder-quobyte-f5470490-c7fd-4186-921d-b8d6ead9f11a" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "cinder-quobyte-f5470490-c7fd-4186-921d-b8d6ead9f11a" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[da07ef82-e671-40a6-8999-8008fabb249f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:39 devstack sudo[87874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a Apr 15 10:11:39 devstack sudo[87874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:39 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25" returned: 0 in 0.508s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1477db45-46ec-4434-b138-604e87be00bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec9b664-b9fc-467b-b306-2628bae86a25', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1beccc9-516a-4857-bd31-c3525be86499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:39 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Volume volume-bec9b664-b9fc-467b-b306-2628bae86a25 (bec9b664-b9fc-467b-b306-2628bae86a25): created successfully Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1beccc9-516a-4857-bd31-c3525be86499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Flow 'volume_create_manager' (d16cd740-a0f4-4329-a7ef-15a6bf14c60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:39 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7b7b6a85-9c24-4a5f-9a4f-3a3f523cda21 tempest-VolumesListAdminTestJSON-841972361 None] Created volume successfully. Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-52aff85f-1eb3-4bea-a6c5-11f70dd90178-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-52aff85f-1eb3-4bea-a6c5-11f70dd90178-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-quobyte-52aff85f-1eb3-4bea-a6c5-11f70dd90178" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-52aff85f-1eb3-4bea-a6c5-11f70dd90178" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Deleting offline snapshot 52aff85f-1eb3-4bea-a6c5-11f70dd90178 of volume 79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] snapshot_file for this snap is: volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:39 devstack sudo[87874]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a" returned: 0 in 0.516s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[55376762-21f5-4bfa-8f43-df921e533ae3]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:39 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a Apr 15 10:11:39 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:39 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 Apr 15 10:11:39 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:40 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f5470490-c7fd-4186-921d-b8d6ead9f11a" returned: 0 in 0.433s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "cinder-quobyte-f5470490-c7fd-4186-921d-b8d6ead9f11a" released by "delete_volume" :: held 0.992s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Created reservations ['0e6e6e82-a44b-4195-b518-3f1dd720b696', '2de259cb-69d2-4454-aa33-6dc50f1c6377', 'cda06300-13e3-4e40-88b8-e9a57d145d06', '1307c5ab-17f7-4096-81f9-4e58adffe697'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:40 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178" returned: 0 in 0.557s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79873bcd-3876-4f07-91f9-a1acea1f4c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:40 devstack sudo[87888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:40 devstack sudo[87888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce478b9d-eba8-4e8f-a53a-60125e13b0a6]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:40 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 Apr 15 10:11:40 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Flow 'volume_create_manager' (da39b15d-4eee-462a-84bb-de1dceae7ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad565a44-abf6-4966-b0fc-a5503382b80b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad565a44-abf6-4966-b0fc-a5503382b80b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1703707835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b0dee2-6782-45e5-9e72-5de6186e7d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56360a4581374932ac8d9de154250e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:41Z,use_quota=True,user_id='6ea3d1e2006a4884aa06160fcc3b7d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695a1d25-d439-4398-b58c-52a6d7816cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (695a1d25-d439-4398-b58c-52a6d7816cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddec53f3-96e2-4ee6-be30-9a4f520367c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddec53f3-96e2-4ee6-be30-9a4f520367c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b0dee2-6782-45e5-9e72-5de6186e7d29', 'volume_name': 'volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d67c04-9608-40a4-b53a-d885f021cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d67c04-9608-40a4-b53a-d885f021cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328f152a-d90c-49d4-8e8c-da5ec32e1cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:40 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Volume a4b0dee2-6782-45e5-9e72-5de6186e7d29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29', 'volume_size': 1} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1703707835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4b0dee2-6782-45e5-9e72-5de6186e7d29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56360a4581374932ac8d9de154250e29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:41Z,use_quota=True,user_id='6ea3d1e2006a4884aa06160fcc3b7d42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Creating volume a4b0dee2-6782-45e5-9e72-5de6186e7d29 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:40 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:40 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 1073741824 Apr 15 10:11:40 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:40 devstack sudo[87888]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.518s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:40 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Deleted volume successfully. Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d484b425-d0d9-4667-90d3-3ec3b358dc32 tempest-VolumesCloneNegativeTest-1083736123 None] Lock "cinder-f5470490-c7fd-4186-921d-b8d6ead9f11a-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:40 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794" returned: 0 in 0.593s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79873bcd-3876-4f07-91f9-a1acea1f4c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:40 devstack sudo[87898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 Apr 15 10:11:40 devstack sudo[87898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:41 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 1073741824" returned: 0 in 0.545s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:41 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 Apr 15 10:11:41 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:41 devstack sudo[87898]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178" returned: 0 in 0.595s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:41 devstack sudo[87908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178 Apr 15 10:11:41 devstack sudo[87908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:41 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29" returned: 0 in 0.516s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328f152a-d90c-49d4-8e8c-da5ec32e1cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3a8cce-23ea-4a57-815a-710ee5ef2f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:41 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Volume volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 (a4b0dee2-6782-45e5-9e72-5de6186e7d29): created successfully Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3a8cce-23ea-4a57-815a-710ee5ef2f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Flow 'volume_create_manager' (da39b15d-4eee-462a-84bb-de1dceae7ba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:41 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c798a7fe-ebcd-415b-8e76-2fc68760738c tempest-VolumesListAdminTestJSON-841972361 None] Created volume successfully. Apr 15 10:11:42 devstack sudo[87908]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.52aff85f-1eb3-4bea-a6c5-11f70dd90178" returned: 0 in 0.499s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-52aff85f-1eb3-4bea-a6c5-11f70dd90178" released by "_delete_snapshot" :: held 2.339s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" released by "delete_snapshot" :: held 2.360s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Created reservations ['390701a6-680a-49c8-89aa-64ad043d36c7', 'de07283c-097f-4d36-ae95-0f24ce92214f', '1f556148-a9a8-4141-848d-1d83ec89aa20', 'a3eb19a3-3334-424a-a896-43c35ccb4fc0'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:42 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Delete snapshot completed successfully. Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e392e3b3-1e51-4913-b942-95edeb02af67 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-52aff85f-1eb3-4bea-a6c5-11f70dd90178-delete_snapshot" released by "delete_snapshot" :: held 2.495s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-d371934e-a8a5-4cdc-8a4a-b730fdae9794-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-d371934e-a8a5-4cdc-8a4a-b730fdae9794-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-quobyte-d371934e-a8a5-4cdc-8a4a-b730fdae9794" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-d371934e-a8a5-4cdc-8a4a-b730fdae9794" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Deleting offline snapshot d371934e-a8a5-4cdc-8a4a-b730fdae9794 of volume 79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] snapshot_file for this snap is: volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[89302bda-c0b6-43ef-a86f-8d099d7d4d60]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:42 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 Apr 15 10:11:42 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Flow 'volume_create_manager' (0d278022-ea10-4a26-b259-ef6e811ca58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0404e2f2-72be-40bf-8767-cb9414a4a376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0404e2f2-72be-40bf-8767-cb9414a4a376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6821ff05-1366-48f6-99f7-00e0e2bf2001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a5cf684e2406e88a8ced71202dc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:43Z,use_quota=True,user_id='aee7c5c3a6fe466bb679d2b39f950414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef150397-acae-4a1f-996b-8da20bfbf23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef150397-acae-4a1f-996b-8da20bfbf23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b207e9-6f77-4ef2-b0a2-40de15ff3d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b207e9-6f77-4ef2-b0a2-40de15ff3d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6821ff05-1366-48f6-99f7-00e0e2bf2001', 'volume_name': 'volume-6821ff05-1366-48f6-99f7-00e0e2bf2001', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b9de2d-8c39-44de-a664-eeed1d377f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96b9de2d-8c39-44de-a664-eeed1d377f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32041a8a-e77d-4b24-968d-1fee98eb67bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Volume 6821ff05-1366-48f6-99f7-00e0e2bf2001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6821ff05-1366-48f6-99f7-00e0e2bf2001', 'volume_size': 1} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6821ff05-1366-48f6-99f7-00e0e2bf2001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58a5cf684e2406e88a8ced71202dc3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:43Z,use_quota=True,user_id='aee7c5c3a6fe466bb679d2b39f950414',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Creating volume 6821ff05-1366-48f6-99f7-00e0e2bf2001 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:43 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:43 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 1073741824 Apr 15 10:11:43 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:43 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794" returned: 0 in 0.683s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79873bcd-3876-4f07-91f9-a1acea1f4c26(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[62329f62-795c-4da6-968c-480af3083d1d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:43 devstack sudo[87921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 Apr 15 10:11:43 devstack sudo[87921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Flow 'volume_create_manager' (77819364-d2cb-4735-be0f-2051c64b6a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14cbb13-4f93-4300-836d-3a08e57731fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14cbb13-4f93-4300-836d-3a08e57731fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-386674584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc43578-3b0d-410d-a80f-91b4f76e3f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863fb4673aa47ddb2607bc95264f402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:44Z,use_quota=True,user_id='2769271eff534a31bc30e34ccd2749c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e34a37-df63-4477-b37c-40e1e7d1df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e34a37-df63-4477-b37c-40e1e7d1df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9325992-66f8-4040-aa9f-c64e187f16fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:43 devstack cinder-volume[82600]: DEBUG cinder.image.glance [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Creating Keystone auth plugin from conf {{(pid=82600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9325992-66f8-4040-aa9f-c64e187f16fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3cc43578-3b0d-410d-a80f-91b4f76e3f30', 'volume_name': 'volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1a3a07-1dc3-4c7e-af7c-a653abb21c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b1a3a07-1dc3-4c7e-af7c-a653abb21c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620ffe7f-80b3-48ba-ac09-6d250a2c5a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:44 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Volume 3cc43578-3b0d-410d-a80f-91b4f76e3f30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Trying to clone 3cc43578-3b0d-410d-a80f-91b4f76e3f30 from image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]). {{(pid=82600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:11:44 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 1073741824" returned: 0 in 0.696s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 Apr 15 10:11:44 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:11:44 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa455f-7c78-4325-adb7-290fe213d650]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:44 devstack sudo[87921]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26" returned: 0 in 0.652s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 Apr 15 10:11:44 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD Apr 15 10:11:44 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001" returned: 0 in 0.485s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32041a8a-e77d-4b24-968d-1fee98eb67bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6821ff05-1366-48f6-99f7-00e0e2bf2001', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869a13d3-e990-4722-a5f7-c2ed7fcd2ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:44 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Volume volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 (6821ff05-1366-48f6-99f7-00e0e2bf2001): created successfully Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869a13d3-e990-4722-a5f7-c2ed7fcd2ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Flow 'volume_create_manager' (0d278022-ea10-4a26-b259-ef6e811ca58f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:44 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-57d403f9-7696-45af-81c7-57fa4c241a66 tempest-VolumesListAdminTestJSON-233780972 None] Created volume successfully. Apr 15 10:11:44 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD" returned: 0 in 0.522s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Temporary image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 is fetched for user 2769271eff534a31bc30e34ccd2749c8. {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:11:44 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794" returned: 0 in 0.542s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794 Apr 15 10:11:44 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c464781d-0c0f-4367-a3a8-690f6e24f467]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:44 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD Apr 15 10:11:44 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:45 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26.d371934e-a8a5-4cdc-8a4a-b730fdae9794" returned: 0 in 0.445s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-d371934e-a8a5-4cdc-8a4a-b730fdae9794" released by "_delete_snapshot" :: held 2.393s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" released by "delete_snapshot" :: held 2.420s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Created reservations ['5e917a16-59cd-406e-abb8-81bbe0e48e53', 'ca0d0ce8-ee25-4716-b964-c0dfbd95ebd3', '1d52e801-d21e-400d-b0c5-8d72f8da6234', 'af1dd7df-5766-4264-a0d1-068c0ff83018'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Delete snapshot completed successfully. Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9843f11e-67a3-4e18-a620-92a61b334d38 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-d371934e-a8a5-4cdc-8a4a-b730fdae9794-delete_snapshot" released by "delete_snapshot" :: held 2.520s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:45 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-386674584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cc43578-3b0d-410d-a80f-91b4f76e3f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863fb4673aa47ddb2607bc95264f402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:44Z,use_quota=True,user_id='2769271eff534a31bc30e34ccd2749c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Creating volume 3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:45 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:45 devstack sudo[87951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 1073741824 Apr 15 10:11:45 devstack sudo[87951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Acquiring lock "cinder-6821ff05-1366-48f6-99f7-00e0e2bf2001-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Lock "cinder-6821ff05-1366-48f6-99f7-00e0e2bf2001-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Acquiring lock "cinder-quobyte-6821ff05-1366-48f6-99f7-00e0e2bf2001" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Lock "cinder-quobyte-6821ff05-1366-48f6-99f7-00e0e2bf2001" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac8b0ab-bdef-4d54-bac4-36251165fda9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "cinder-a4b0dee2-6782-45e5-9e72-5de6186e7d29-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-a4b0dee2-6782-45e5-9e72-5de6186e7d29-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "cinder-quobyte-a4b0dee2-6782-45e5-9e72-5de6186e7d29" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-quobyte-a4b0dee2-6782-45e5-9e72-5de6186e7d29" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:45 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 Apr 15 10:11:45 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f26c99-db07-44a2-868d-037bec01ec71]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:45 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 Apr 15 10:11:45 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:45 devstack sudo[87951]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 1073741824" returned: 0 in 0.612s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 Apr 15 10:11:46 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-79873bcd-3876-4f07-91f9-a1acea1f4c26-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-79873bcd-3876-4f07-91f9-a1acea1f4c26-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f39a51-aa17-46c2-b2d6-540a90a5a6f1]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001" returned: 0 in 0.625s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[87969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001 Apr 15 10:11:46 devstack sudo[87969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29" returned: 0 in 0.563s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 Apr 15 10:11:46 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29 Apr 15 10:11:46 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30" returned: 0 in 0.507s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Attempting download of 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}])) to volume 3cc43578-3b0d-410d-a80f-91b4f76e3f30. {{(pid=82600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[580117dd-25e7-4db1-a89d-14fb2258c73c]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_doeffzbp {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[87969]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6821ff05-1366-48f6-99f7-00e0e2bf2001" returned: 0 in 0.463s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack sudo[87976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_doeffzbp Apr 15 10:11:46 devstack sudo[87976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Lock "cinder-quobyte-6821ff05-1366-48f6-99f7-00e0e2bf2001" released by "delete_volume" :: held 1.117s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:46 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Created reservations ['827506af-8937-40f3-908d-d264dca2a8ca', '75902f0b-5e09-4a18-8ea1-78746def6e24', '1cb8f66a-22e4-4e8c-802b-d5b4b87c0ef8', '05d233c4-e267-47ea-a909-02aed2bc31fe'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a4b0dee2-6782-45e5-9e72-5de6186e7d29" returned: 0 in 0.483s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-quobyte-a4b0dee2-6782-45e5-9e72-5de6186e7d29" released by "delete_volume" :: held 1.073s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:46 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Created reservations ['0dc8ef82-5c8b-4678-90a8-fcef5a1b25c5', '163620b6-a77f-477e-8c6e-7c4c06f06d83', 'e93e8b80-34bf-4572-8226-025056fefdc3', 'b310db8b-94e4-444c-94fa-2f445ae427d2'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26" returned: 0 in 0.648s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26 Apr 15 10:11:46 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[87984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:46 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:46 devstack sudo[87986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:46 devstack sudo[87986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:47 devstack sudo[87976]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_doeffzbp" returned: 0 in 0.645s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_doeffzbp {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:47 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-79873bcd-3876-4f07-91f9-a1acea1f4c26" returned: 0 in 0.460s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-quobyte-79873bcd-3876-4f07-91f9-a1acea1f4c26" released by "delete_volume" :: held 1.145s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Created reservations ['fd2300f3-2c28-4ef1-bc3b-b91e73e9fe9e', 'c82951a1-4469-40df-b6e7-266935e068ff', '763bd175-6cb5-46a9-b1f5-42cd3568e5c7', '1e650053-4c2b-4c4e-8fed-27111acc6f86'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:47 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.472s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:47 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_doeffzbp Apr 15 10:11:47 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:47 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Deleted volume successfully. Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5cae8464-b163-4ed5-9e67-71b5ffd49513 tempest-VolumesListAdminTestJSON-233780972 None] Lock "cinder-6821ff05-1366-48f6-99f7-00e0e2bf2001-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:47 devstack sudo[87986]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.495s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:47 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Deleted volume successfully. Apr 15 10:11:47 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:47 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-97ce342e-a920-41e9-8961-80ae11901b35 tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-a4b0dee2-6782-45e5-9e72-5de6186e7d29-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:47 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_doeffzbp" returned: 1 in 0.524s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_doeffzbp' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f71899-abd4-4f49-8354-3a22f5a6c767]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:47 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD Apr 15 10:11:47 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:47 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.491s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:47 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Deleted volume successfully. Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0bc9d03f-d10a-4971-bcdb-be8f2d3a1975 tempest-VolumesSnapshotListTestJSON-1160353498 None] Lock "cinder-79873bcd-3876-4f07-91f9-a1acea1f4c26-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "cinder-bec9b664-b9fc-467b-b306-2628bae86a25-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-bec9b664-b9fc-467b-b306-2628bae86a25-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "cinder-quobyte-bec9b664-b9fc-467b-b306-2628bae86a25" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-quobyte-bec9b664-b9fc-467b-b306-2628bae86a25" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[485214e9-127e-4aff-8212-571e4fe76682]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:48 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25 Apr 15 10:11:48 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:48 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD" returned: 0 in 0.548s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:48 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 was qcow2, converting to raw {{(pid=82600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:11:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:48 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 Apr 15 10:11:48 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:48 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25" returned: 0 in 0.564s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:48 devstack sudo[88012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25 Apr 15 10:11:48 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:49 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bec9b664-b9fc-467b-b306-2628bae86a25" returned: 0 in 0.642s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-quobyte-bec9b664-b9fc-467b-b306-2628bae86a25" released by "delete_volume" :: held 1.247s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Created reservations ['3149779d-94f4-4139-961f-7c0f9f221ae4', '742977f8-cf92-4b2a-b30c-d5c3fc40cc3a', 'c1b4a6cc-eb54-49bd-9ab4-204556c57932', 'd62ef06a-bdb8-4c78-abf2-3bc719486683'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:49 devstack sudo[88031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:49 devstack sudo[88031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:49 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30" returned: 0 in 1.162s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_yne7878udevstack@QuobyteHD, size 112.00 MB, duration 1.16 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:11:49 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Converted 112.00 MB image at 96.26 MB/s Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:49 devstack sudo[88033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 1G Apr 15 10:11:49 devstack sudo[88033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:49 devstack sudo[88031]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.505s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:49 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Deleted volume successfully. Apr 15 10:11:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-54a7d858-d618-4394-bb07-b7601cbc0b74 tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-bec9b664-b9fc-467b-b306-2628bae86a25-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:50 devstack sudo[88033]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 1G" returned: 0 in 0.564s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a59390-f294-4443-9c42-295b7b9edbc3]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:50 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 Apr 15 10:11:50 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "cinder-eb4a415b-5da2-4059-a542-abc1791cb9bc-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-eb4a415b-5da2-4059-a542-abc1791cb9bc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "cinder-quobyte-eb4a415b-5da2-4059-a542-abc1791cb9bc" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-quobyte-eb4a415b-5da2-4059-a542-abc1791cb9bc" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5c792f-81e9-4748-911b-ace06accddb7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:50 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc Apr 15 10:11:50 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Flow 'volume_create_manager' (bbf3f002-f644-4fec-9ce7-a72e8d70c895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b304ff-8487-4642-a122-7abff285593d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b304ff-8487-4642-a122-7abff285593d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2103972988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d0f641-1177-4ffe-8f32-eb69b9ea850a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6606db8e18478497dacb577a0fa31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:50Z,use_quota=True,user_id='36404a220df347f1bd6cc0d1d3e42f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9233f8f-6eb1-451d-abbb-1d3219da68f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9233f8f-6eb1-451d-abbb-1d3219da68f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc511c11-7cd3-406f-9cde-6316314688e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc511c11-7cd3-406f-9cde-6316314688e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d0f641-1177-4ffe-8f32-eb69b9ea850a', 'volume_name': 'volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a', 'volume_size': 2}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb9b153-bdfb-4cf7-a896-e55180af8559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb9b153-bdfb-4cf7-a896-e55180af8559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d53104d-941c-4a6d-af62-52ff84f8e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:50 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Volume c2d0f641-1177-4ffe-8f32-eb69b9ea850a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a', 'volume_size': 2} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2103972988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d0f641-1177-4ffe-8f32-eb69b9ea850a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6606db8e18478497dacb577a0fa31f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:50Z,use_quota=True,user_id='36404a220df347f1bd6cc0d1d3e42f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Creating volume c2d0f641-1177-4ffe-8f32-eb69b9ea850a {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:50 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a 2147483648 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:50 devstack sudo[88043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a 2147483648 Apr 15 10:11:50 devstack sudo[88043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:50 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30" returned: 0 in 0.597s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:50 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 Apr 15 10:11:50 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:50 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc" returned: 0 in 0.590s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:50 devstack sudo[88061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc Apr 15 10:11:50 devstack sudo[88061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:51 devstack sudo[88043]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a 2147483648" returned: 0 in 0.567s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:51 devstack sudo[88063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a Apr 15 10:11:51 devstack sudo[88063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:51 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30" returned: 1 in 0.552s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Downloaded image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}])) to volume 3cc43578-3b0d-410d-a80f-91b4f76e3f30 successfully. {{(pid=82600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Temporary image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 for user 2769271eff534a31bc30e34ccd2749c8 is deleted. {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Marking volume 3cc43578-3b0d-410d-a80f-91b4f76e3f30 as bootable. {{(pid=82600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Copying metadata from image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 to 3cc43578-3b0d-410d-a80f-91b4f76e3f30. {{(pid=82600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Creating volume glance metadata for volume 3cc43578-3b0d-410d-a80f-91b4f76e3f30 backed by image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (620ffe7f-80b3-48ba-ac09-6d250a2c5a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c345d9-cc33-49c2-a92f-746692759f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:51 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Volume volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 (3cc43578-3b0d-410d-a80f-91b4f76e3f30): created successfully Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c345d9-cc33-49c2-a92f-746692759f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Flow 'volume_create_manager' (77819364-d2cb-4735-be0f-2051c64b6a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-901e6824-0032-451d-be75-0f49f3fa0995 tempest-VolumesExtendTest-811148002 None] Created volume successfully. Apr 15 10:11:51 devstack sudo[88061]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb4a415b-5da2-4059-a542-abc1791cb9bc" returned: 0 in 0.491s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-quobyte-eb4a415b-5da2-4059-a542-abc1791cb9bc" released by "delete_volume" :: held 1.118s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Created reservations ['61385d6c-d1f7-44dd-8ce2-2d65983a1379', '7a24b8db-b47e-4281-bd34-01bf9f44bc55', '7e7e4ebf-3aa8-4d5b-9fc4-4fc49e5ccc8e', '239baafb-51d5-4103-b6df-c95a1b43bb42'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:51 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:51 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:51 devstack sudo[88063]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" returned: 0 in 0.488s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d53104d-941c-4a6d-af62-52ff84f8e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a', 'volume_size': 2}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3357a0-b703-4804-b041-c3910bd09f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:51 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Volume volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a (c2d0f641-1177-4ffe-8f32-eb69b9ea850a): created successfully Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3357a0-b703-4804-b041-c3910bd09f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Flow 'volume_create_manager' (bbf3f002-f644-4fec-9ce7-a72e8d70c895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-01c4eea4-2b94-49ee-8b58-893793f879b7 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Created volume successfully. Apr 15 10:11:51 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.423s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Deleted volume successfully. Apr 15 10:11:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-988ff39d-4f1f-4f27-8f53-0a57b658fd3a tempest-VolumesListAdminTestJSON-841972361 None] Lock "cinder-eb4a415b-5da2-4059-a542-abc1791cb9bc-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:52 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a509c4f8-c749-4048-a02d-37b066eaa156]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:52 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 Apr 15 10:11:52 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:53 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30" returned: 0 in 0.610s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:53 devstack sudo[88080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 Apr 15 10:11:53 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:53 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30" returned: 1 in 0.604s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 2G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 2G" returned: 0 in 0.090s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.342s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.075s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Creating offline snapshot 6d682fc7-ad39-4ca7-a61f-0de4421773f0 of volume c2d0f641-1177-4ffe-8f32-eb69b9ea850a {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4410aed9-ba02-4f23-bd8b-9bb3f0cb90ab]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:53 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a Apr 15 10:11:53 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:53 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6e2d8c6c-d24c-404b-9de7-538f93dd5b99 tempest-VolumesExtendTest-811148002 None] Extend volume completed successfully. Apr 15 10:11:54 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" returned: 0 in 0.535s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 2G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:54 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 2G Apr 15 10:11:54 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Acquiring lock "cinder-3cc43578-3b0d-410d-a80f-91b4f76e3f30-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Lock "cinder-3cc43578-3b0d-410d-a80f-91b4f76e3f30-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Acquiring lock "cinder-quobyte-3cc43578-3b0d-410d-a80f-91b4f76e3f30" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Lock "cinder-quobyte-3cc43578-3b0d-410d-a80f-91b4f76e3f30" acquired by "delete_volume" :: waited 0.019s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8167b335-1a50-4598-8429-2bbdca1434db]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:54 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 2G" returned: 0 in 0.615s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:54 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 Apr 15 10:11:54 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:54 devstack sudo[88098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 Apr 15 10:11:54 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:55 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0" returned: 0 in 0.549s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:55 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 is being set with open permissions: ugo+rw Apr 15 10:11:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:55 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30" returned: 0 in 0.593s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:55 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 Apr 15 10:11:55 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:55 devstack sudo[88108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 Apr 15 10:11:55 devstack sudo[88108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:55 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0" returned: 0 in 0.498s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:56 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.info Apr 15 10:11:56 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:56 devstack sudo[88108]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30" returned: 1 in 0.609s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:56 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30 Apr 15 10:11:56 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:56 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.info" returned: 0 in 0.488s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:56 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.info is being set with open permissions: ugo+rw Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:56 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.info Apr 15 10:11:56 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:56 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3cc43578-3b0d-410d-a80f-91b4f76e3f30" returned: 0 in 0.526s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Lock "cinder-quobyte-3cc43578-3b0d-410d-a80f-91b4f76e3f30" released by "delete_volume" :: held 1.781s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Created reservations ['510fe05d-007f-4045-898d-036892cfc7b9', '0b8e8216-dbf5-4169-bc35-ce82e70aa204', 'd376b75d-be08-4398-97ac-522d73e4dfa4', 'db0b45af-6d90-4b70-a5aa-a989d0f9278c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:56 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:11:56 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:56 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.info" returned: 0 in 0.510s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.269s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6c479641-0f1f-47fe-bb31-74c814e05fb9 tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Create snapshot completed successfully Apr 15 10:11:57 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.544s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:11:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Deleted volume successfully. Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d1fa3a84-cbd0-485d-8048-316db72acf5f tempest-VolumesExtendTest-811148002 None] Lock "cinder-3cc43578-3b0d-410d-a80f-91b4f76e3f30-delete_volume" released by "delete_volume" :: held 2.520s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Flow 'volume_create_manager' (19048dc6-bb9f-4089-91f0-5f5ae0aea6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25afa01-379e-499e-b616-ad9acf9ae699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25afa01-379e-499e-b616-ad9acf9ae699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2067839174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e7b691-3a31-4439-bdcd-627415d014fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863fb4673aa47ddb2607bc95264f402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:57Z,use_quota=True,user_id='2769271eff534a31bc30e34ccd2749c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89543a39-69eb-45b2-8557-0afb1619427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89543a39-69eb-45b2-8557-0afb1619427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54c697d-bdaf-4f62-b0ad-5fcb22976012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a54c697d-bdaf-4f62-b0ad-5fcb22976012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e7b691-3a31-4439-bdcd-627415d014fe', 'volume_name': 'volume-45e7b691-3a31-4439-bdcd-627415d014fe', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de3bd55-631d-430e-96f8-ceb7c00c0c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de3bd55-631d-430e-96f8-ceb7c00c0c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9393c30b-a766-48a2-b695-00f44ec43f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:57 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Volume 45e7b691-3a31-4439-bdcd-627415d014fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e7b691-3a31-4439-bdcd-627415d014fe', 'volume_size': 1} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2067839174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e7b691-3a31-4439-bdcd-627415d014fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863fb4673aa47ddb2607bc95264f402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:57Z,use_quota=True,user_id='2769271eff534a31bc30e34ccd2749c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Creating volume 45e7b691-3a31-4439-bdcd-627415d014fe {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:57 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:57 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe 1073741824 Apr 15 10:11:57 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Acquiring lock "cinder-6d682fc7-ad39-4ca7-a61f-0de4421773f0-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-6d682fc7-ad39-4ca7-a61f-0de4421773f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Acquiring lock "cinder-quobyte-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-quobyte-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Acquiring lock "cinder-quobyte-6d682fc7-ad39-4ca7-a61f-0de4421773f0" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-quobyte-6d682fc7-ad39-4ca7-a61f-0de4421773f0" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Deleting offline snapshot 6d682fc7-ad39-4ca7-a61f-0de4421773f0 of volume c2d0f641-1177-4ffe-8f32-eb69b9ea850a {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] snapshot_file for this snap is: volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b043a04-e746-4fe3-b6aa-d6ac40d775b0]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:11:58 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Flow 'volume_create_manager' (0f109939-810f-496f-bd3b-e9ff187c0110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324e3465-6493-4981-9dda-4db83a9383c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (324e3465-6493-4981-9dda-4db83a9383c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2000113801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da4f160-4887-4db6-b50c-cf14066c816f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bb4584b01f4eb5ae9d7d887a055903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:58Z,use_quota=True,user_id='40b8435c11a04c6f9dc1b7b6441e031c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71472b07-d72c-4920-9302-ce579775fb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71472b07-d72c-4920-9302-ce579775fb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 Apr 15 10:11:58 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0d00ee-5035-4744-9fb7-abb4c9f5f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c0d00ee-5035-4744-9fb7-abb4c9f5f648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da4f160-4887-4db6-b50c-cf14066c816f', 'volume_name': 'volume-6da4f160-4887-4db6-b50c-cf14066c816f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5207e7-8f0c-4450-a1a4-098f8b7e7749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5207e7-8f0c-4450-a1a4-098f8b7e7749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963d88a7-460e-43a5-9de4-59dded8ffef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:58 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Volume 6da4f160-4887-4db6-b50c-cf14066c816f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da4f160-4887-4db6-b50c-cf14066c816f', 'volume_size': 1} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe 1073741824" returned: 0 in 0.773s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:58 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe Apr 15 10:11:58 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:58 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe" returned: 0 in 0.435s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2000113801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da4f160-4887-4db6-b50c-cf14066c816f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bb4584b01f4eb5ae9d7d887a055903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:11:58Z,use_quota=True,user_id='40b8435c11a04c6f9dc1b7b6441e031c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Creating volume 6da4f160-4887-4db6-b50c-cf14066c816f {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:11:58 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:58 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9393c30b-a766-48a2-b695-00f44ec43f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e7b691-3a31-4439-bdcd-627415d014fe', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15167f7-030e-4a80-813c-82806b2e9ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:58 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f 1073741824 Apr 15 10:11:58 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0" returned: 0 in 0.623s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:11:58 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Volume volume-45e7b691-3a31-4439-bdcd-627415d014fe (45e7b691-3a31-4439-bdcd-627415d014fe): created successfully Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15167f7-030e-4a80-813c-82806b2e9ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Flow 'volume_create_manager' (19048dc6-bb9f-4089-91f0-5f5ae0aea6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc72ab33-06ed-47cb-adf2-2f0ad96bb239]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4bc130aa-2744-46dc-9867-18e495c4f001 tempest-VolumesExtendTest-811148002 None] Created volume successfully. Apr 15 10:11:58 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a Apr 15 10:11:58 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:59 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f 1073741824" returned: 0 in 0.529s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:59 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" returned: 0 in 0.509s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:59 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f Apr 15 10:11:59 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:59 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 Apr 15 10:11:59 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:11:59 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f" returned: 0 in 0.495s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.166s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963d88a7-460e-43a5-9de4-59dded8ffef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da4f160-4887-4db6-b50c-cf14066c816f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944df574-bcbc-4f6c-9258-ef98b010f94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Creating offline snapshot f681f1ae-67bf-450e-8459-ba1e78935ed9 of volume 45e7b691-3a31-4439-bdcd-627415d014fe {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:11:59 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0" returned: 0 in 0.515s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5d51c4-418a-4979-9b4a-b3bf1fbdc067]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:11:59 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0 Apr 15 10:11:59 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:11:59 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Volume volume-6da4f160-4887-4db6-b50c-cf14066c816f (6da4f160-4887-4db6-b50c-cf14066c816f): created successfully Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (944df574-bcbc-4f6c-9258-ef98b010f94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:11:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Flow 'volume_create_manager' (0f109939-810f-496f-bd3b-e9ff187c0110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:11:59 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cac9a894-2497-453d-835d-1a3b94c7d82b tempest-VolumesTransfersTest-1076753120 None] Created volume successfully. Apr 15 10:11:59 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe Apr 15 10:11:59 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:00 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a.6d682fc7-ad39-4ca7-a61f-0de4421773f0" returned: 0 in 0.462s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-quobyte-6d682fc7-ad39-4ca7-a61f-0de4421773f0" released by "_delete_snapshot" :: held 2.210s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-quobyte-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" released by "delete_snapshot" :: held 2.229s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:00 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Created reservations ['662716f5-021b-4fee-9e1a-55d4e92c1fc1', 'eda31401-b69c-4a73-9b26-9b61f0439055', 'c018037d-7844-4f77-8c5b-56579c6c1bb6', '6c9780c1-c895-4819-aba7-ab70e58093b0'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:00 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe" returned: 0 in 0.578s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:00 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 1G Apr 15 10:12:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Delete snapshot completed successfully. Apr 15 10:12:00 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7046bdb5-c09d-4b5a-89fd-5dcaffec72dd tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-6d682fc7-ad39-4ca7-a61f-0de4421773f0-delete_snapshot" released by "delete_snapshot" :: held 2.364s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4104557c-46fb-4799-9115-a08443080aff tempest-VolumesTransfersTest-1088254824 None] Transfer volume completed successfully. Apr 15 10:12:00 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 1G" returned: 0 in 0.566s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e7b691-3a31-4439-bdcd-627415d014fe -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:00 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e7b691-3a31-4439-bdcd-627415d014fe -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 Apr 15 10:12:00 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Acquiring lock "cinder-c2d0f641-1177-4ffe-8f32-eb69b9ea850a-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-c2d0f641-1177-4ffe-8f32-eb69b9ea850a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Acquiring lock "cinder-quobyte-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-quobyte-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bf932e-0ebf-4a68-951a-57b8321b8bc8]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:01 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a Apr 15 10:12:01 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:01 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45e7b691-3a31-4439-bdcd-627415d014fe -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9" returned: 0 in 0.533s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:01 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 is being set with open permissions: ugo+rw Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:01 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 Apr 15 10:12:01 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Acquiring lock "cinder-6da4f160-4887-4db6-b50c-cf14066c816f-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Lock "cinder-6da4f160-4887-4db6-b50c-cf14066c816f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Acquiring lock "cinder-quobyte-6da4f160-4887-4db6-b50c-cf14066c816f" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Lock "cinder-quobyte-6da4f160-4887-4db6-b50c-cf14066c816f" acquired by "delete_volume" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1464d2-90ec-40d3-843c-25b1154413bf]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:01 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f Apr 15 10:12:01 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:01 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" returned: 0 in 0.586s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:01 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a Apr 15 10:12:01 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:01 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9" returned: 0 in 0.493s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:01 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.info Apr 15 10:12:01 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:02 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f" returned: 0 in 0.554s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:02 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f Apr 15 10:12:02 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:02 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" returned: 0 in 0.466s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-quobyte-c2d0f641-1177-4ffe-8f32-eb69b9ea850a" released by "delete_volume" :: held 1.093s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Created reservations ['eeee27bc-0994-410e-ab0b-a0b8827d843a', '8ecc2e88-3831-481c-93cc-3845461caabc', '7dfb7482-72b8-493d-ac0d-79011d78b9c3', 'c779751f-68d1-4bef-b8c4-adefe8298e9b'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:02 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.info" returned: 0 in 0.471s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:02 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.info is being set with open permissions: ugo+rw Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:02 devstack sudo[88233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.info Apr 15 10:12:02 devstack sudo[88233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:02 devstack sudo[88234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:02 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:02 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6da4f160-4887-4db6-b50c-cf14066c816f" returned: 0 in 0.511s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Lock "cinder-quobyte-6da4f160-4887-4db6-b50c-cf14066c816f" released by "delete_volume" :: held 1.092s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Created reservations ['d72b4cae-853c-4159-b255-16254a8eee0d', 'fa171ed4-3b6b-4180-b02b-e987d0e40afa', 'e3a4a755-24e9-4335-871b-b5eb4a2e9bc8', 'eebaf674-3464-48ef-9254-192f09a90d89'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:02 devstack sudo[88233]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.info" returned: 0 in 0.450s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.170s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:02 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.501s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:02 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Deleted volume successfully. Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:02 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-107da1fd-e4b9-439a-9367-daad17f6cfc7 tempest-VolumesExtendTest-811148002 None] Create snapshot completed successfully Apr 15 10:12:02 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:03 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-bdcad4a0-dd03-4a0d-822d-f7aabf24748f tempest-VolumesSnapshotNegativeTestJSON-1433108221 None] Lock "cinder-c2d0f641-1177-4ffe-8f32-eb69b9ea850a-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:03 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.506s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:03 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:03 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Deleted volume successfully. Apr 15 10:12:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e56303c-2b62-407b-b7ad-0797a3fce72c tempest-VolumesTransfersTest-267497973 None] Lock "cinder-6da4f160-4887-4db6-b50c-cf14066c816f-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05cc228f-d6f0-446a-9a57-5d1ab4908b36 tempest-VolumesExtendTest-811148002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05cc228f-d6f0-446a-9a57-5d1ab4908b36 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:03 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[868c90f1-1a3b-4349-bea1-36169aa23a37]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05cc228f-d6f0-446a-9a57-5d1ab4908b36 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:03 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe Apr 15 10:12:03 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Flow 'volume_create_manager' (4f8ed3b0-4c41-4750-995e-8e2a05da9a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9dd8988-bd41-47da-9c9e-10d3f71d24ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9dd8988-bd41-47da-9c9e-10d3f71d24ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1413244359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c623a38b-dca4-4194-894e-40302ad9e10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bb4584b01f4eb5ae9d7d887a055903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:04Z,use_quota=True,user_id='40b8435c11a04c6f9dc1b7b6441e031c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e260fd0-bb77-4a4a-9f3f-13cfe985133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e260fd0-bb77-4a4a-9f3f-13cfe985133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743b844f-833b-47db-a872-ff1f29db6780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (743b844f-833b-47db-a872-ff1f29db6780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c623a38b-dca4-4194-894e-40302ad9e10c', 'volume_name': 'volume-c623a38b-dca4-4194-894e-40302ad9e10c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1946d51f-4a23-458b-8bd8-634733a7278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1946d51f-4a23-458b-8bd8-634733a7278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1b7079-67ca-4f9a-8999-2fafa2885661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:04 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Volume c623a38b-dca4-4194-894e-40302ad9e10c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c623a38b-dca4-4194-894e-40302ad9e10c', 'volume_size': 1} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:04 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05cc228f-d6f0-446a-9a57-5d1ab4908b36 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe" returned: 0 in 0.625s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05cc228f-d6f0-446a-9a57-5d1ab4908b36 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 2G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05cc228f-d6f0-446a-9a57-5d1ab4908b36 tempest-VolumesExtendTest-811148002 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 2G" returned: 0 in 0.072s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05cc228f-d6f0-446a-9a57-5d1ab4908b36 tempest-VolumesExtendTest-811148002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.715s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1413244359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c623a38b-dca4-4194-894e-40302ad9e10c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bb4584b01f4eb5ae9d7d887a055903',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:04Z,use_quota=True,user_id='40b8435c11a04c6f9dc1b7b6441e031c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Creating volume c623a38b-dca4-4194-894e-40302ad9e10c {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:04 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:04 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c 1073741824 Apr 15 10:12:04 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-05cc228f-d6f0-446a-9a57-5d1ab4908b36 tempest-VolumesExtendTest-811148002 None] Extend volume completed successfully. Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Acquiring lock "cinder-f681f1ae-67bf-450e-8459-ba1e78935ed9-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Lock "cinder-f681f1ae-67bf-450e-8459-ba1e78935ed9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Acquiring lock "cinder-quobyte-45e7b691-3a31-4439-bdcd-627415d014fe" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Lock "cinder-quobyte-45e7b691-3a31-4439-bdcd-627415d014fe" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Acquiring lock "cinder-quobyte-f681f1ae-67bf-450e-8459-ba1e78935ed9" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Lock "cinder-quobyte-f681f1ae-67bf-450e-8459-ba1e78935ed9" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Deleting offline snapshot f681f1ae-67bf-450e-8459-ba1e78935ed9 of volume 45e7b691-3a31-4439-bdcd-627415d014fe {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] snapshot_file for this snap is: volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3089eef-6b12-4ca6-9df7-5e6526d0f162]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c 1073741824" returned: 0 in 0.629s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:05 devstack sudo[88256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 Apr 15 10:12:05 devstack sudo[88256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c Apr 15 10:12:05 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (fa90c138-ef32-4d9f-926c-c9a12426a6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662534c9-a2a3-40ab-95d6-0ed0b67c31eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (662534c9-a2a3-40ab-95d6-0ed0b67c31eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692420586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:05Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1f08ed-4895-4981-b8f4-af51e9b21386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a1f08ed-4895-4981-b8f4-af51e9b21386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c47a180-84dd-46b0-8e5c-9f548c5fd7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c47a180-84dd-46b0-8e5c-9f548c5fd7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22', 'volume_name': 'volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07085325-5ed7-48ac-ae2b-9039d575c8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07085325-5ed7-48ac-ae2b-9039d575c8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddf53eb-107d-4778-a0ec-a68702057660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Volume 6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22', 'volume_size': 1} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (1ee2709d-8b6f-4149-a207-e0ed3c706659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793a64e0-7b8e-4af6-bf88-04cc728fb717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (793a64e0-7b8e-4af6-bf88-04cc728fb717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-352590584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b72951-b3f3-4e2a-9506-fb3fe0dbea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:06Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e621add-eb17-4eff-9766-2037bf1f3014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e621add-eb17-4eff-9766-2037bf1f3014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74118c0-9de3-4ca5-884f-33eae25bc7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b74118c0-9de3-4ca5-884f-33eae25bc7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0b72951-b3f3-4e2a-9506-fb3fe0dbea05', 'volume_name': 'volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2454588-0843-408b-a6fc-a2986198a86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2454588-0843-408b-a6fc-a2986198a86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774f163b-e0c4-4037-a0ac-a975e12090fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Volume a0b72951-b3f3-4e2a-9506-fb3fe0dbea05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05', 'volume_size': 1} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:05 devstack sudo[88256]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:05 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9" returned: 0 in 0.660s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45e7b691-3a31-4439-bdcd-627415d014fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c" returned: 0 in 0.582s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[99686760-fabf-4ff0-ad01-66710a0a1ee3]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.386s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-692420586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:05Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Creating volume 6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:05 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:05 devstack sudo[88264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 1073741824 Apr 15 10:12:05 devstack sudo[88264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1b7079-67ca-4f9a-8999-2fafa2885661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c623a38b-dca4-4194-894e-40302ad9e10c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2017243-803c-4c71-99ab-509ff32fad7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (0c9dfbe8-5d88-4361-ad27-e185f3502a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b17451e-fcc4-4507-bd15-c0adaaf36cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b17451e-fcc4-4507-bd15-c0adaaf36cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-318651417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c396d8b0-93c1-411b-88a8-66a87326b3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:06Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530c3c3a-a989-4b17-b301-9af2e2dfbbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530c3c3a-a989-4b17-b301-9af2e2dfbbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9879862-28e7-432c-b231-315d54d113bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9879862-28e7-432c-b231-315d54d113bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c396d8b0-93c1-411b-88a8-66a87326b3af', 'volume_name': 'volume-c396d8b0-93c1-411b-88a8-66a87326b3af', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace9b5a6-5c59-4d9b-92a6-2a28d8c9cae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ace9b5a6-5c59-4d9b-92a6-2a28d8c9cae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2618a1f-a068-4d8c-8cca-39ddea81962b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Volume c396d8b0-93c1-411b-88a8-66a87326b3af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c396d8b0-93c1-411b-88a8-66a87326b3af', 'volume_size': 1} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:06 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Volume volume-c623a38b-dca4-4194-894e-40302ad9e10c (c623a38b-dca4-4194-894e-40302ad9e10c): created successfully Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2017243-803c-4c71-99ab-509ff32fad7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Flow 'volume_create_manager' (4f8ed3b0-4c41-4750-995e-8e2a05da9a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:06 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a5d2a7fe-0e96-403e-ada5-b50a08fe8f90 tempest-VolumesTransfersTest-1076753120 None] Created volume successfully. Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (99050ad7-dbd4-4d7d-bfa8-924969b37d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660534a7-7c83-4a14-a346-aafae037d90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660534a7-7c83-4a14-a346-aafae037d90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1722895294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a8f3a5-62c6-4ff6-b4f7-86ec5f332846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:06Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeef7d8-71a2-47f4-a5d8-db4f79e87dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eeef7d8-71a2-47f4-a5d8-db4f79e87dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f351f6-6d90-49a5-a052-7c3acf099153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f351f6-6d90-49a5-a052-7c3acf099153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95a8f3a5-62c6-4ff6-b4f7-86ec5f332846', 'volume_name': 'volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c368ee4-f2a1-4172-af8c-9db7d2c8e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c368ee4-f2a1-4172-af8c-9db7d2c8e438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d60c92-2308-4aed-b850-dae937e64632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Volume 95a8f3a5-62c6-4ff6-b4f7-86ec5f332846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846', 'volume_size': 1} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (19815f31-126a-463e-85ad-50e3d9f2eb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78455d2b-e0f2-4eb0-8a63-c906d3f3a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78455d2b-e0f2-4eb0-8a63-c906d3f3a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-909532363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73289e0-4c37-4376-899e-109a8434a33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:06Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:06 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5651131a-4501-4f72-ba69-93629fa39402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5651131a-4501-4f72-ba69-93629fa39402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569f6d30-1d22-4914-b555-f6bda63e0c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569f6d30-1d22-4914-b555-f6bda63e0c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73289e0-4c37-4376-899e-109a8434a33c', 'volume_name': 'volume-e73289e0-4c37-4376-899e-109a8434a33c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950d6714-f152-4b71-bc37-011aca677194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950d6714-f152-4b71-bc37-011aca677194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22044c36-bcd9-49f4-9d28-902bfcd78122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:06 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Volume e73289e0-4c37-4376-899e-109a8434a33c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73289e0-4c37-4376-899e-109a8434a33c', 'volume_size': 1} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe" returned: 0 in 0.647s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:06 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 Apr 15 10:12:06 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Acquiring lock "cinder-c623a38b-dca4-4194-894e-40302ad9e10c-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Lock "cinder-c623a38b-dca4-4194-894e-40302ad9e10c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:06 devstack sudo[88264]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Acquiring lock "cinder-quobyte-c623a38b-dca4-4194-894e-40302ad9e10c" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 1073741824" returned: 0 in 0.780s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Lock "cinder-quobyte-c623a38b-dca4-4194-894e-40302ad9e10c" acquired by "delete_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3c2c3c-7ce3-41fe-b7b6-90951776a596]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:06 devstack sudo[88277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 Apr 15 10:12:06 devstack sudo[88277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:06 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c Apr 15 10:12:06 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:07 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9" returned: 0 in 0.509s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9 Apr 15 10:12:07 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:07 devstack sudo[88277]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22" returned: 0 in 0.451s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.470s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-352590584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0b72951-b3f3-4e2a-9506-fb3fe0dbea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:06Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Creating volume a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:07 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ddf53eb-107d-4778-a0ec-a68702057660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51bd950-9c52-48c1-8f73-7e85272b3248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:07 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 1073741824 Apr 15 10:12:07 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:07 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Volume volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 (6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22): created successfully Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51bd950-9c52-48c1-8f73-7e85272b3248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (fa90c138-ef32-4d9f-926c-c9a12426a6f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:07 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-656f4635-761d-43ca-98a2-6451ac1ec9dc tempest-CreateVolumesFromImageTest-654039165 None] Created volume successfully. Apr 15 10:12:07 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c" returned: 0 in 0.551s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack sudo[88291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c Apr 15 10:12:07 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:07 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe.f681f1ae-67bf-450e-8459-ba1e78935ed9" returned: 0 in 0.495s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Lock "cinder-quobyte-f681f1ae-67bf-450e-8459-ba1e78935ed9" released by "_delete_snapshot" :: held 2.406s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Lock "cinder-quobyte-45e7b691-3a31-4439-bdcd-627415d014fe" released by "delete_snapshot" :: held 2.423s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Created reservations ['87289768-71c3-4c27-9bde-f2a4e9f66d95', '1bc62aab-5717-4e56-8590-7aa8b90b17ab', 'dda32102-14b6-4836-aa69-2c6ee6b4fb7b', 'fba0e3bf-bf66-4c31-b060-d510a9d7ba7f'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:07 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Delete snapshot completed successfully. Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5aa3ea1b-fe0a-44bc-b987-02e9a1627aa3 tempest-VolumesExtendTest-811148002 None] Lock "cinder-f681f1ae-67bf-450e-8459-ba1e78935ed9-delete_snapshot" released by "delete_snapshot" :: held 2.554s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:07 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c623a38b-dca4-4194-894e-40302ad9e10c" returned: 0 in 0.499s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Lock "cinder-quobyte-c623a38b-dca4-4194-894e-40302ad9e10c" released by "delete_volume" :: held 1.073s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:07 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 1073741824" returned: 0 in 0.590s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Created reservations ['5222a38e-7f84-466a-9caf-f40adee726f3', '00e4af58-1fb9-4455-9651-3db9dd5518b5', '4eef1c38-78ee-44da-b1b8-fe95baa7be40', '7a02c87d-3af4-4cbc-827d-08820621764d'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:07 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 Apr 15 10:12:07 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:07 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:07 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:08 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05" returned: 0 in 0.464s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.261s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-318651417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c396d8b0-93c1-411b-88a8-66a87326b3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:06Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Creating volume c396d8b0-93c1-411b-88a8-66a87326b3af {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:08 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (774f163b-e0c4-4037-a0ac-a975e12090fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af4e095-b2bc-4264-a558-0a33987a1ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:08 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.450s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:08 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Volume volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 (a0b72951-b3f3-4e2a-9506-fb3fe0dbea05): created successfully Apr 15 10:12:08 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af 1073741824 Apr 15 10:12:08 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af4e095-b2bc-4264-a558-0a33987a1ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (1ee2709d-8b6f-4149-a207-e0ed3c706659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:08 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ba7bf83c-67d1-40a4-a9e2-266636c82490 tempest-CreateVolumesFromImageTest-654039165 None] Created volume successfully. Apr 15 10:12:08 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Deleted volume successfully. Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d0c5b671-2430-47da-be7e-38978f92e0af tempest-VolumesTransfersTest-267497973 None] Lock "cinder-c623a38b-dca4-4194-894e-40302ad9e10c-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Acquiring lock "cinder-45e7b691-3a31-4439-bdcd-627415d014fe-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Lock "cinder-45e7b691-3a31-4439-bdcd-627415d014fe-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Acquiring lock "cinder-quobyte-45e7b691-3a31-4439-bdcd-627415d014fe" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Lock "cinder-quobyte-45e7b691-3a31-4439-bdcd-627415d014fe" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[58cfb080-96f2-4b02-b3b6-4935250ed6a9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe Apr 15 10:12:08 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:08 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af 1073741824" returned: 0 in 0.578s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:08 devstack sudo[88311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af Apr 15 10:12:08 devstack sudo[88311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:09 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe" returned: 0 in 0.591s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:09 devstack sudo[88316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe Apr 15 10:12:09 devstack sudo[88316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:09 devstack sudo[88311]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af" returned: 0 in 0.464s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.163s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1722895294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95a8f3a5-62c6-4ff6-b4f7-86ec5f332846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:06Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Creating volume 95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:09 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2618a1f-a068-4d8c-8cca-39ddea81962b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c396d8b0-93c1-411b-88a8-66a87326b3af', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:09 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 1073741824 Apr 15 10:12:09 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9fb182-8d34-42d4-b5e3-5d429804d2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:09 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Volume volume-c396d8b0-93c1-411b-88a8-66a87326b3af (c396d8b0-93c1-411b-88a8-66a87326b3af): created successfully Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9fb182-8d34-42d4-b5e3-5d429804d2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (0c9dfbe8-5d88-4361-ad27-e185f3502a1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:09 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f5045272-37a2-4223-9054-1f5311112c65 tempest-CreateVolumesFromImageTest-654039165 None] Created volume successfully. Apr 15 10:12:09 devstack sudo[88316]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-45e7b691-3a31-4439-bdcd-627415d014fe" returned: 0 in 0.553s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Lock "cinder-quobyte-45e7b691-3a31-4439-bdcd-627415d014fe" released by "delete_volume" :: held 1.210s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Created reservations ['910a0f25-16cf-44a1-9ffa-030ba93eb62b', 'c2ae6c83-4710-4226-ad24-06f19692b44f', '1485403a-9ea6-42cb-93cd-b84d6c1a4be0', '7d382759-7b78-4b9f-84fc-39d4e9ebefb3'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:09 devstack sudo[88322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:09 devstack sudo[88322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:09 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 1073741824" returned: 0 in 0.625s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:10 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 Apr 15 10:12:10 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:10 devstack sudo[88322]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:10 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:10 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.468s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:10 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Deleted volume successfully. Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-fd5d4b54-fd17-4ee2-ad71-08e72b970a3c tempest-VolumesExtendTest-811148002 None] Lock "cinder-45e7b691-3a31-4439-bdcd-627415d014fe-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:10 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846" returned: 0 in 0.513s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.996s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-909532363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73289e0-4c37-4376-899e-109a8434a33c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc7199cac31492481be51375c21e68c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:06Z,use_quota=True,user_id='d916f946a5a84af08f7c335d8a620434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Creating volume e73289e0-4c37-4376-899e-109a8434a33c {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:10 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:10 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c 1073741824 Apr 15 10:12:10 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d60c92-2308-4aed-b850-dae937e64632) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf66f91-bf95-4c7b-ba9e-e150d8f51a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:10 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Volume volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 (95a8f3a5-62c6-4ff6-b4f7-86ec5f332846): created successfully Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf66f91-bf95-4c7b-ba9e-e150d8f51a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (99050ad7-dbd4-4d7d-bfa8-924969b37d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:10 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-91596d2a-2dc7-4d93-8522-1b1f40e0ffe4 tempest-CreateVolumesFromImageTest-654039165 None] Created volume successfully. Apr 15 10:12:10 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.484s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:11 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c 1073741824" returned: 0 in 0.604s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:UPDATE=223,cinder:SELECT=187,cinder:INSERT=69,cinder:DELETE=22 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:11 devstack sudo[88339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c Apr 15 10:12:11 devstack sudo[88339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:11 devstack sudo[88339]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c" returned: 0 in 0.526s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22044c36-bcd9-49f4-9d28-902bfcd78122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73289e0-4c37-4376-899e-109a8434a33c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3c2c90-e913-4dec-a992-a67e9cf36dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:11 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Volume volume-e73289e0-4c37-4376-899e-109a8434a33c (e73289e0-4c37-4376-899e-109a8434a33c): created successfully Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3c2c90-e913-4dec-a992-a67e9cf36dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Flow 'volume_create_manager' (19815f31-126a-463e-85ad-50e3d9f2eb0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:11 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-821aa271-34ea-46ba-8690-3990615e04c4 tempest-CreateVolumesFromImageTest-654039165 None] Created volume successfully. Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-e73289e0-4c37-4376-899e-109a8434a33c-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-e73289e0-4c37-4376-899e-109a8434a33c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-quobyte-e73289e0-4c37-4376-899e-109a8434a33c" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-e73289e0-4c37-4376-899e-109a8434a33c" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:12 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac583702-a46d-4230-971b-033542e5f573]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:12 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c Apr 15 10:12:12 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:12 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c" returned: 0 in 0.600s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:12 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c Apr 15 10:12:12 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:12 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (ad03bb4c-6ea6-44bc-9d2d-372dfdb77cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50ada25-d878-4bf7-b594-1bc3e46a06a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50ada25-d878-4bf7-b594-1bc3e46a06a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-689043745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74972f6-b799-4d6d-b60f-00534ed02ec2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:13Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d129ee5-9c37-4788-ba85-0a5d417e2860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d129ee5-9c37-4788-ba85-0a5d417e2860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897eb382-60ca-4831-8637-b31702ce5ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (897eb382-60ca-4831-8637-b31702ce5ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74972f6-b799-4d6d-b60f-00534ed02ec2', 'volume_name': 'volume-e74972f6-b799-4d6d-b60f-00534ed02ec2', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cc604f-e3bd-462f-a0d0-c7e10dfe8333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cc604f-e3bd-462f-a0d0-c7e10dfe8333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d7541d-895e-4f71-8553-9eede782c707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:13 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Volume e74972f6-b799-4d6d-b60f-00534ed02ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74972f6-b799-4d6d-b60f-00534ed02ec2', 'volume_size': 1} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-689043745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74972f6-b799-4d6d-b60f-00534ed02ec2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:13Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Creating volume e74972f6-b799-4d6d-b60f-00534ed02ec2 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:13 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:13 devstack sudo[88350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 1073741824 Apr 15 10:12:13 devstack sudo[88350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:13 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e73289e0-4c37-4376-899e-109a8434a33c" returned: 0 in 0.527s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-e73289e0-4c37-4376-899e-109a8434a33c" released by "delete_volume" :: held 1.164s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Created reservations ['331746e4-3c80-496e-babd-ab83c53267d1', '8dd9e219-c578-4369-b9b8-f47a4c8f4d89', 'f2ce8a91-bd99-4cd5-8fe8-4e8157056e64', '608b357a-f58c-44ac-bfe0-a40943a80e0a'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:13 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:13 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:13 devstack sudo[88350]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 1073741824" returned: 0 in 0.647s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:13 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 Apr 15 10:12:13 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:13 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.562s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Deleted volume successfully. Apr 15 10:12:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-dc0328be-b473-435b-9157-65fed340ae5c tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-e73289e0-4c37-4376-899e-109a8434a33c-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-quobyte-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6b6ee7-f714-4215-b98a-663a373aabc9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:14 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2" returned: 0 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d7541d-895e-4f71-8553-9eede782c707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74972f6-b799-4d6d-b60f-00534ed02ec2', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b3a984-f0a8-46ea-ab5d-32dbd36e5a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:14 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 Apr 15 10:12:14 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:14 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Volume volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 (e74972f6-b799-4d6d-b60f-00534ed02ec2): created successfully Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16b3a984-f0a8-46ea-ab5d-32dbd36e5a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (ad03bb4c-6ea6-44bc-9d2d-372dfdb77cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:14 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0f7cdd88-d827-46b7-a6e7-8cded77147b2 tempest-VolumesGetTest-21188703 None] Created volume successfully. Apr 15 10:12:14 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846" returned: 0 in 0.571s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:14 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846 Apr 15 10:12:14 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:15 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846" returned: 0 in 0.516s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846" released by "delete_volume" :: held 1.121s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Created reservations ['352dc304-2439-41d7-a53f-e0dcf17e779b', 'ff8aec77-4cac-4bb8-bd8e-6ceacadbd1a5', 'ad0ca63e-87e6-4c97-b350-675cfd3d8bcb', 'd6866f18-9e9e-4107-af1c-f34ef7cf598c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:15 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:15 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (17b6d414-341a-4f75-bcc1-fcf85ab48277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe7e4bd-e201-4d39-8cfc-77bf356ad195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe7e4bd-e201-4d39-8cfc-77bf356ad195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-501640105',display_name='tempest-VolumesGetTest-Volume-1787357372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7237dbe-a44d-4e7d-af68-9d87d446a083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:16Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dad8632-d4d6-46fe-bad1-7bc0540d01a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dad8632-d4d6-46fe-bad1-7bc0540d01a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ed2abd-bf85-4dd0-b0ce-24920f2eb4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ed2abd-bf85-4dd0-b0ce-24920f2eb4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7237dbe-a44d-4e7d-af68-9d87d446a083', 'volume_name': 'volume-f7237dbe-a44d-4e7d-af68-9d87d446a083', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcca2a36-3e66-4bfd-8f6b-a482afc5ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcca2a36-3e66-4bfd-8f6b-a482afc5ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd9f267-a611-41a0-8790-9f15ec89d360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:15 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Volume f7237dbe-a44d-4e7d-af68-9d87d446a083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7237dbe-a44d-4e7d-af68-9d87d446a083', 'volume_size': 1} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-501640105',display_name='tempest-VolumesGetTest-Volume-1787357372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7237dbe-a44d-4e7d-af68-9d87d446a083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:16Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Creating volume f7237dbe-a44d-4e7d-af68-9d87d446a083 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:15 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:15 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 1073741824 Apr 15 10:12:15 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:15 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.507s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:15 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Deleted volume successfully. Apr 15 10:12:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4cf215c9-4f98-4012-9cbb-a704ce4b0b99 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-95a8f3a5-62c6-4ff6-b4f7-86ec5f332846-delete_volume" released by "delete_volume" :: held 1.795s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:16 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 1073741824" returned: 0 in 0.568s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:16 devstack sudo[88378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 Apr 15 10:12:16 devstack sudo[88378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-c396d8b0-93c1-411b-88a8-66a87326b3af-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-c396d8b0-93c1-411b-88a8-66a87326b3af-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-quobyte-c396d8b0-93c1-411b-88a8-66a87326b3af" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-c396d8b0-93c1-411b-88a8-66a87326b3af" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5f5b6f-61df-4428-826d-d7db4bfeb494]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:16 devstack sudo[88380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af Apr 15 10:12:16 devstack sudo[88380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:16 devstack sudo[88378]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083" returned: 0 in 0.511s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcd9f267-a611-41a0-8790-9f15ec89d360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7237dbe-a44d-4e7d-af68-9d87d446a083', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf42fa0-00c5-40ab-9bd8-229d0969e100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:16 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Volume volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 (f7237dbe-a44d-4e7d-af68-9d87d446a083): created successfully Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddf42fa0-00c5-40ab-9bd8-229d0969e100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:16 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (17b6d414-341a-4f75-bcc1-fcf85ab48277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:16 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-406cf3f5-9b55-45e9-a8c9-96a3d8340d33 tempest-VolumesGetTest-21188703 None] Created volume successfully. Apr 15 10:12:17 devstack sudo[88380]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af" returned: 0 in 0.656s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af Apr 15 10:12:17 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c396d8b0-93c1-411b-88a8-66a87326b3af" returned: 0 in 0.514s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-c396d8b0-93c1-411b-88a8-66a87326b3af" released by "delete_volume" :: held 1.204s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Created reservations ['fb7f51e7-28d7-494d-ac4c-148aacfe8b8e', '44b55409-37d5-48bd-b284-015e8c7f63f5', '50837bd3-8f2c-4466-a149-7ebc1ef0c1ba', '497f09c7-84cc-407c-b1fa-50e7ca4dd02d'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-f7237dbe-a44d-4e7d-af68-9d87d446a083-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:17 devstack sudo[88389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:17 devstack sudo[88389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Lock "cinder-f7237dbe-a44d-4e7d-af68-9d87d446a083-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-quobyte-f7237dbe-a44d-4e7d-af68-9d87d446a083" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-f7237dbe-a44d-4e7d-af68-9d87d446a083" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2451ed27-0910-4a66-8987-b4f7985a9699]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 Apr 15 10:12:18 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:18 devstack sudo[88389]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.495s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:18 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Deleted volume successfully. Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0a188465-600c-4e7a-86a5-f4e0280f8c07 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-c396d8b0-93c1-411b-88a8-66a87326b3af-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:18 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083" returned: 0 in 0.578s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083 Apr 15 10:12:18 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-quobyte-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d546880-863a-409d-b653-f655ccc8b65f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:18 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 Apr 15 10:12:18 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7237dbe-a44d-4e7d-af68-9d87d446a083" returned: 0 in 0.597s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-f7237dbe-a44d-4e7d-af68-9d87d446a083" released by "delete_volume" :: held 1.198s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Created reservations ['fdd853c0-7b0a-43e8-aa32-51a9b7810e7c', '482599ae-9c93-4987-8113-2bf9c979f534', '79a70b70-cc42-4f6a-9b9e-0e819d47e881', '881025b4-89e2-495c-bfb4-f55ee42ec14c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:19 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:19 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05" returned: 0 in 0.701s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:19 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05 Apr 15 10:12:19 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Flow 'volume_create_manager' (434ecf4f-edda-4b48-b4a5-e23f860b5720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6256f8cf-c2df-40b2-9e1a-de76b234bc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6256f8cf-c2df-40b2-9e1a-de76b234bc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1371303606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7721919-a046-49b9-9071-5f8126b520c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbaf154369d44e3bad3fb1565698275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:20Z,use_quota=True,user_id='e5a89b02fabe4e3dbb6071432683eb3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f843926-7074-4be1-b00f-92214981e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f843926-7074-4be1-b00f-92214981e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa0dae-198d-4939-a61e-466a836d53fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fa0dae-198d-4939-a61e-466a836d53fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7721919-a046-49b9-9071-5f8126b520c3', 'volume_name': 'volume-d7721919-a046-49b9-9071-5f8126b520c3', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a3d5c6-27d3-4448-bd59-7012236a43fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a3d5c6-27d3-4448-bd59-7012236a43fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b964e387-59d2-4321-9f79-7a416e11a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:19 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Volume d7721919-a046-49b9-9071-5f8126b520c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7721919-a046-49b9-9071-5f8126b520c3', 'volume_size': 1} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1371303606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7721919-a046-49b9-9071-5f8126b520c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecbaf154369d44e3bad3fb1565698275',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:20Z,use_quota=True,user_id='e5a89b02fabe4e3dbb6071432683eb3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Creating volume d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:19 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:19 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 1073741824 Apr 15 10:12:19 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:19 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.517s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:19 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Deleted volume successfully. Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-9e75d36f-42ae-44b7-9b4b-eaf1fc135888 tempest-VolumesGetTest-21188703 None] Lock "cinder-f7237dbe-a44d-4e7d-af68-9d87d446a083-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:19 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05" returned: 0 in 0.508s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05" released by "delete_volume" :: held 1.239s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:19 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Created reservations ['b52b49d2-ece8-450c-abbb-0e5a29e3abdb', 'bc775faa-c691-490d-badb-1f58d1f58ec8', 'c52ed873-44c6-4857-ae28-ed3c22b9c9da', 'eaccf5d9-f6d3-4209-b77b-e3ce6fd732e3'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:20 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:20 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-e74972f6-b799-4d6d-b60f-00534ed02ec2-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Lock "cinder-e74972f6-b799-4d6d-b60f-00534ed02ec2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-quobyte-e74972f6-b799-4d6d-b60f-00534ed02ec2" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-e74972f6-b799-4d6d-b60f-00534ed02ec2" acquired by "delete_volume" :: waited 0.019s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc540b-1235-42af-97bf-20833e0f2e20]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:20 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 1073741824" returned: 0 in 0.593s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:20 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 Apr 15 10:12:20 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 Apr 15 10:12:20 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:20 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:20 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.469s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:20 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Deleted volume successfully. Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-43e7d07f-6490-4122-88ef-0080bc7fa576 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-a0b72951-b3f3-4e2a-9506-fb3fe0dbea05-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:20 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3" returned: 0 in 0.446s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:20 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2" returned: 0 in 0.507s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b964e387-59d2-4321-9f79-7a416e11a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7721919-a046-49b9-9071-5f8126b520c3', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:20 devstack sudo[88427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2 Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8319cc-ecd7-4c96-9eff-a248e2145ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:20 devstack sudo[88427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:20 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Volume volume-d7721919-a046-49b9-9071-5f8126b520c3 (d7721919-a046-49b9-9071-5f8126b520c3): created successfully Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d8319cc-ecd7-4c96-9eff-a248e2145ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Flow 'volume_create_manager' (434ecf4f-edda-4b48-b4a5-e23f860b5720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:20 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b1ee161b-5b7c-4986-ad02-c5c9e037e807 tempest-VolumesActionsTest-1308765022 None] Created volume successfully. Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "cinder-quobyte-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4951f05-6fcc-479a-80ed-ef10a9735819]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:20 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 Apr 15 10:12:20 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:21 devstack sudo[88427]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e74972f6-b799-4d6d-b60f-00534ed02ec2" returned: 0 in 0.461s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-e74972f6-b799-4d6d-b60f-00534ed02ec2" released by "delete_volume" :: held 0.991s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Created reservations ['ca0e96b0-72f7-4034-9aa3-6f0fdc25a4f3', 'f3179d06-b07b-47d7-aea4-d7371419cc01', 'e4fd872f-807e-4ed7-8f20-36e2a3a63279', 'fe4a89b7-3f01-4010-bc87-ad7663d89c38'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:21 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:21 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:21 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22" returned: 0 in 0.535s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:21 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22 Apr 15 10:12:21 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:21 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.487s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:21 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Deleted volume successfully. Apr 15 10:12:21 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b7759854-d9c2-4b0b-83fc-5f89fa18f803 tempest-VolumesGetTest-21188703 None] Lock "cinder-e74972f6-b799-4d6d-b60f-00534ed02ec2-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:22 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22" returned: 0 in 0.601s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-quobyte-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22" released by "delete_volume" :: held 1.165s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=176,cinder:INSERT=58,cinder:UPDATE=244,cinder:DELETE=18 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Created reservations ['51cf4ef6-dd5c-43ac-8c7b-32ef3dacef4f', '64935d2a-241a-483d-bf48-6e35d203f781', '2c6653d1-eaf6-4662-a385-86ecb7468668', 'dfcb6c93-e0a1-4644-ada4-07d0459548d1'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:22 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:22 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (9da31af3-c96f-4a5e-93ec-178f211082cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadf170c-d12b-4d78-ad33-f894ab5dd8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadf170c-d12b-4d78-ad33-f894ab5dd8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1880948481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fc43a3-748c-4a38-97d2-0950ffc97a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:23Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d403811-c34d-43c4-84b4-ef09a7de93ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d403811-c34d-43c4-84b4-ef09a7de93ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2756e6-83ec-4034-a803-2f7c3e4ab7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf2756e6-83ec-4034-a803-2f7c3e4ab7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4fc43a3-748c-4a38-97d2-0950ffc97a27', 'volume_name': 'volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa86552-c90f-4e74-a333-c9e77973ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa86552-c90f-4e74-a333-c9e77973ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa0bfc3-9d32-4a87-bbaa-be369ad358f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:22 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Volume b4fc43a3-748c-4a38-97d2-0950ffc97a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27', 'volume_size': 1} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1880948481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fc43a3-748c-4a38-97d2-0950ffc97a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:23Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Creating volume b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:22 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.573s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:22 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Deleted volume successfully. Apr 15 10:12:22 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 1073741824 Apr 15 10:12:22 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8d318250-20a1-4245-9637-a361d7e0fc34 tempest-CreateVolumesFromImageTest-654039165 None] Lock "cinder-6e3486d1-7b00-4c8a-a1d4-6b481d1f6f22-delete_volume" released by "delete_volume" :: held 1.960s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:23 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 1073741824" returned: 0 in 0.712s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:23 devstack sudo[88454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 Apr 15 10:12:23 devstack sudo[88454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:24 devstack sudo[88454]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27" returned: 0 in 0.531s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baa0bfc3-9d32-4a87-bbaa-be369ad358f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7e283c-09ba-4e2e-b86d-28813a22980f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:24 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Volume volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 (b4fc43a3-748c-4a38-97d2-0950ffc97a27): created successfully Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e7e283c-09ba-4e2e-b86d-28813a22980f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (9da31af3-c96f-4a5e-93ec-178f211082cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:24 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6e1e575c-f6b8-47dd-8d1f-d66c8b0d89df tempest-VolumesGetTest-21188703 None] Created volume successfully. Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (648a636a-4948-469f-96e6-9c921d057d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:24 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f7faa6-e8c4-430c-8d0a-2286cf5e8fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f7faa6-e8c4-430c-8d0a-2286cf5e8fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2112510720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb20b668-3aef-4ad0-8414-ad6c7cf97069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:25Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec42804f-3908-48da-8cc2-deb5c65cf327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec42804f-3908-48da-8cc2-deb5c65cf327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f9db8b-39b2-4734-a937-f983fc5d5e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f9db8b-39b2-4734-a937-f983fc5d5e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb20b668-3aef-4ad0-8414-ad6c7cf97069', 'volume_name': 'volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3317b7-27af-42b7-af7a-c68c863262d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3317b7-27af-42b7-af7a-c68c863262d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0f6c58-4025-4a08-b114-f8fff45df7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume eb20b668-3aef-4ad0-8414-ad6c7cf97069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069', 'volume_size': 1} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2112510720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb20b668-3aef-4ad0-8414-ad6c7cf97069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:25Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Creating volume eb20b668-3aef-4ad0-8414-ad6c7cf97069 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:25 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:25 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 1073741824 Apr 15 10:12:25 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (55d84c98-df30-4ee2-861f-fb31a86a9357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e496d5b7-c061-4eca-a067-8c956b06cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e496d5b7-c061-4eca-a067-8c956b06cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-178059318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80fcbd34-ba14-4a70-a991-d6c01aaf02df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b4fc43a3-748c-4a38-97d2-0950ffc97a27,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:25Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3857db4d-4afc-4717-96f5-230e41c22708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3857db4d-4afc-4717-96f5-230e41c22708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03c86f4-37a1-4338-83bb-8d2bbaca2ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f03c86f4-37a1-4338-83bb-8d2bbaca2ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '80fcbd34-ba14-4a70-a991-d6c01aaf02df', 'volume_name': 'volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df', 'volume_size': 1, 'source_volid': 'b4fc43a3-748c-4a38-97d2-0950ffc97a27', 'source_volstatus': 'available'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8e39e6-5dee-4d18-9eb9-fed796151aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db8e39e6-5dee-4d18-9eb9-fed796151aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630f5678-5791-4c53-b3b5-c89dfd4558c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:25 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Volume 80fcbd34-ba14-4a70-a991-d6c01aaf02df: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df', 'volume_size': 1, 'source_volid': 'b4fc43a3-748c-4a38-97d2-0950ffc97a27', 'source_volstatus': 'available'} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:25 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 1073741824" returned: 0 in 0.569s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:25 devstack sudo[88463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 Apr 15 10:12:25 devstack sudo[88463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:26 devstack sudo[88463]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069" returned: 0 in 0.448s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.899s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:26 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Cloning volume b4fc43a3-748c-4a38-97d2-0950ffc97a27 to volume 80fcbd34-ba14-4a70-a991-d6c01aaf02df Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f0f6c58-4025-4a08-b114-f8fff45df7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db71d291-0018-4253-abed-3d6556929127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:26 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 (eb20b668-3aef-4ad0-8414-ad6c7cf97069): created successfully Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db71d291-0018-4253-abed-3d6556929127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (648a636a-4948-469f-96e6-9c921d057d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Creating offline snapshot fb73ebf9-9b12-456d-affd-160d8aaca749 of volume b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:12:26 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0d91a202-7034-4028-963a-1c14f12fb040 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created volume successfully. Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1630c006-4383-4adb-adb8-2642873bc1b2]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:26 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 Apr 15 10:12:26 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:26 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27" returned: 0 in 0.525s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:26 devstack sudo[88471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 1G Apr 15 10:12:26 devstack sudo[88471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:27 devstack sudo[88471]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 1G" returned: 0 in 0.591s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:27 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 Apr 15 10:12:27 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (9deda2b7-9300-434f-9a60-c52b904738a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab343a9-a85b-4b7e-86ce-7ea75b424ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab343a9-a85b-4b7e-86ce-7ea75b424ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482977979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2a3011-c9b4-4dea-b3b2-114031263a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:27Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2904e880-7bd4-4037-a8a9-bfe769cd87ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2904e880-7bd4-4037-a8a9-bfe769cd87ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32dbbad-be0d-41a9-9c37-9b296422b6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e32dbbad-be0d-41a9-9c37-9b296422b6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2a3011-c9b4-4dea-b3b2-114031263a76', 'volume_name': 'volume-cd2a3011-c9b4-4dea-b3b2-114031263a76', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5729496a-eb26-470b-aa62-52420c8fd6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5729496a-eb26-470b-aa62-52420c8fd6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf1f157-320a-4f7e-9daf-2bd3e1c43e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume cd2a3011-c9b4-4dea-b3b2-114031263a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2a3011-c9b4-4dea-b3b2-114031263a76', 'volume_size': 1} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (58b419a8-ba2f-41a5-93f5-e60a07c21885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2557193-487b-4fe9-84c8-ab247513524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2557193-487b-4fe9-84c8-ab247513524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1993481763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bc5754-cb97-4db1-8dc6-ca8337f4559b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d1ec34-293e-43b6-8c57-414d17d10b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d1ec34-293e-43b6-8c57-414d17d10b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4237eee1-de5d-42ed-9a25-a8aaf6b31fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4237eee1-de5d-42ed-9a25-a8aaf6b31fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3bc5754-cb97-4db1-8dc6-ca8337f4559b', 'volume_name': 'volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5830153f-73af-4515-8572-2b9732ab2815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5830153f-73af-4515-8572-2b9732ab2815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f63301-5d9f-4305-9704-6a99f9c57514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume f3bc5754-cb97-4db1-8dc6-ca8337f4559b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b', 'volume_size': 1} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:27 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749" returned: 0 in 0.579s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:27 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 is being set with open permissions: ugo+rw Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:27 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 Apr 15 10:12:27 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (ebadb38a-e4c5-4acf-91a9-1476f377b83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a682fd-d8ba-4a09-bd2b-32be97da8cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a682fd-d8ba-4a09-bd2b-32be97da8cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104643325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bafad4-ea53-4203-9518-39c0d005d2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d6e483-942d-4d01-bf68-f399cde33769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d6e483-942d-4d01-bf68-f399cde33769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db3f251-e27a-4290-9cff-3a88a9cd8224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3db3f251-e27a-4290-9cff-3a88a9cd8224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7bafad4-ea53-4203-9518-39c0d005d2ca', 'volume_name': 'volume-f7bafad4-ea53-4203-9518-39c0d005d2ca', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53bd9cc-ba60-4106-9027-64cd06b35c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b53bd9cc-ba60-4106-9027-64cd06b35c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de2b42f-5a8f-4cde-acc0-f2ed1514a530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:27 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume f7bafad4-ea53-4203-9518-39c0d005d2ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7bafad4-ea53-4203-9518-39c0d005d2ca', 'volume_size': 1} Apr 15 10:12:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (ee1674ae-20b9-483d-a97f-c0404aa1958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fded639d-f88b-49eb-be69-dec245676af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fded639d-f88b-49eb-be69-dec245676af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303345618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb75ed51-9f66-4593-b10d-1061d50ae501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0503467-db12-40a6-b2a4-0b3357dca1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0503467-db12-40a6-b2a4-0b3357dca1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce94377-de86-4fa5-9bd6-28c70f626d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ce94377-de86-4fa5-9bd6-28c70f626d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb75ed51-9f66-4593-b10d-1061d50ae501', 'volume_name': 'volume-eb75ed51-9f66-4593-b10d-1061d50ae501', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bab27b4-b92c-4e85-97b8-994750847eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bab27b4-b92c-4e85-97b8-994750847eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65821205-02e6-4f4c-8ce5-9512467b6761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume eb75ed51-9f66-4593-b10d-1061d50ae501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb75ed51-9f66-4593-b10d-1061d50ae501', 'volume_size': 1} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:28 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749" returned: 0 in 0.597s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (e3621762-6f5b-4340-b2ce-1092db2fa2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce85f86-d42c-4a67-bf70-b12b602236a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ce85f86-d42c-4a67-bf70-b12b602236a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2136254497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad07e50-3f73-4390-9d02-aa592771d1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4effef-d241-4930-a9b3-128f503572a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa4effef-d241-4930-a9b3-128f503572a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e223cb76-c686-4fff-a54c-9ec111476434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e223cb76-c686-4fff-a54c-9ec111476434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fad07e50-3f73-4390-9d02-aa592771d1de', 'volume_name': 'volume-fad07e50-3f73-4390-9d02-aa592771d1de', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a71c95-5f56-4105-89ec-0298105d06ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a71c95-5f56-4105-89ec-0298105d06ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064a49f5-b363-4655-bc97-cf03d7f81cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:28 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume fad07e50-3f73-4390-9d02-aa592771d1de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fad07e50-3f73-4390-9d02-aa592771d1de', 'volume_size': 1} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:28 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.info Apr 15 10:12:28 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:29 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.info" returned: 0 in 0.550s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:29 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.info is being set with open permissions: ugo+rw Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:29 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.info Apr 15 10:12:29 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:29 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.info" returned: 0 in 0.520s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-quobyte-80fcbd34-ba14-4a70-a991-d6c01aaf02df" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-80fcbd34-ba14-4a70-a991-d6c01aaf02df" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] snapshot: fb73ebf9-9b12-456d-affd-160d8aaca749, volume: 80fcbd34-ba14-4a70-a991-d6c01aaf02df, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6dc256-3d70-4d68-b0b4-ce3d10407e38]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:29 devstack sudo[88505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 Apr 15 10:12:29 devstack sudo[88505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:30 devstack sudo[88505]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749" returned: 0 in 0.557s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:12:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:12:30 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[415fc3f4-ac42-4590-a08e-6f70977e5754]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:30 devstack sudo[88511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 Apr 15 10:12:30 devstack sudo[88511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:30 devstack sudo[88511]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27" returned: 0 in 0.516s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:30 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:12:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:30 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df Apr 15 10:12:30 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:33 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df" returned: 0 in 2.288s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa4aa6f-4645-4f4c-9bca-5e75e40dffd9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:33 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 Apr 15 10:12:33 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:33 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27" returned: 0 in 0.689s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:33 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:12:33 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Converted 1024.00 MB image at 447.29 MB/s Apr 15 10:12:33 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df is being set with open permissions: ugo+rw Apr 15 10:12:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:33 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df Apr 15 10:12:33 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:34 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df" returned: 0 in 0.453s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-80fcbd34-ba14-4a70-a991-d6c01aaf02df" released by "_copy_volume_from_snapshot" :: held 4.553s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-quobyte-fb73ebf9-9b12-456d-affd-160d8aaca749" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-fb73ebf9-9b12-456d-affd-160d8aaca749" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Deleting offline snapshot fb73ebf9-9b12-456d-affd-160d8aaca749 of volume b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] snapshot_file for this snap is: volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c71495-5915-4f57-a7ca-f8066c8b150c]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:34 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 Apr 15 10:12:34 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:34 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749" returned: 0 in 0.524s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bacf49-d5f6-458b-a6f2-198a292bc164]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:34 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 Apr 15 10:12:34 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:35 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27" returned: 0 in 0.532s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:35 devstack sudo[88553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 Apr 15 10:12:35 devstack sudo[88553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:35 devstack sudo[88553]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749" returned: 0 in 0.665s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:35 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749 Apr 15 10:12:35 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:36 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27.fb73ebf9-9b12-456d-affd-160d8aaca749" returned: 0 in 0.531s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-fb73ebf9-9b12-456d-affd-160d8aaca749" released by "_delete_snapshot" :: held 2.303s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.450s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.045s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1482977979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2a3011-c9b4-4dea-b3b2-114031263a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:27Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Creating volume cd2a3011-c9b4-4dea-b3b2-114031263a76 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:36 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (630f5678-5791-4c53-b3b5-c89dfd4558c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df', 'volume_size': 1, 'source_volid': 'b4fc43a3-748c-4a38-97d2-0950ffc97a27', 'source_volstatus': 'available'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:36 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 1073741824 Apr 15 10:12:36 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69efc17-7922-4f1a-aa44-15143ab73cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:36 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Volume volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df (80fcbd34-ba14-4a70-a991-d6c01aaf02df): created successfully Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69efc17-7922-4f1a-aa44-15143ab73cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:36 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (55d84c98-df30-4ee2-861f-fb31a86a9357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:36 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-3dd7da3e-27b0-474c-a825-cf4f913b4f6d tempest-VolumesGetTest-21188703 None] Created volume successfully. Apr 15 10:12:37 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 1073741824" returned: 0 in 0.596s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:37 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 Apr 15 10:12:37 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (782e76fd-4324-4181-b3cf-113e5aadd736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12bfb0c-f327-43e1-b3b9-a039fdfae9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12bfb0c-f327-43e1-b3b9-a039fdfae9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-793120844',display_name='tempest-VolumesGetTest-Volume-1677036496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb902a1-c53f-4a85-8509-1e43ec01a5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:37Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d252f708-a22b-488c-a0ca-da1a5a487899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d252f708-a22b-488c-a0ca-da1a5a487899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49844901-8c15-45ce-88f8-53eca7805499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49844901-8c15-45ce-88f8-53eca7805499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cb902a1-c53f-4a85-8509-1e43ec01a5a4', 'volume_name': 'volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc7fa6f-0f28-4722-a559-1110b8575c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fc7fa6f-0f28-4722-a559-1110b8575c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73ad192-4244-47f8-87c7-35c2e20de493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:37 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Volume 0cb902a1-c53f-4a85-8509-1e43ec01a5a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4', 'volume_size': 1} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ede15219-e699-4af0-a616-47f400d3877c tempest-VolumesActionsTest-1308765022 None] Acquiring lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3" by "attach_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ede15219-e699-4af0-a616-47f400d3877c tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3" acquired by "attach_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:37 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ede15219-e699-4af0-a616-47f400d3877c tempest-VolumesActionsTest-1308765022 None] Attaching volume d7721919-a046-49b9-9071-5f8126b520c3 to instance 6e74729d-2fe3-4ba6-93bf-051c15cedf74 at mountpoint /dev/vdb on host None. Apr 15 10:12:37 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ede15219-e699-4af0-a616-47f400d3877c tempest-VolumesActionsTest-1308765022 None] Attach volume completed successfully. Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ede15219-e699-4af0-a616-47f400d3877c tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3" released by "attach_volume" :: held 0.068s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:37 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76" returned: 0 in 0.561s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.999s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1993481763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3bc5754-cb97-4db1-8dc6-ca8337f4559b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Creating volume f3bc5754-cb97-4db1-8dc6-ca8337f4559b {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:37 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf1f157-320a-4f7e-9daf-2bd3e1c43e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2a3011-c9b4-4dea-b3b2-114031263a76', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31118b2-be40-40dd-bc66-d823f45771ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:37 devstack sudo[88597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b 1073741824 Apr 15 10:12:37 devstack sudo[88597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:37 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 (cd2a3011-c9b4-4dea-b3b2-114031263a76): created successfully Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31118b2-be40-40dd-bc66-d823f45771ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:37 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (9deda2b7-9300-434f-9a60-c52b904738a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:37 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b65d4d2e-362b-4b9c-baa1-fdd139cea385 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created volume successfully. Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-20c37d4b-3f39-497e-954d-3ac2276a42f0 tempest-VolumesActionsTest-1308765022 None] Acquiring lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3-detach_volume" by "detach_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-20c37d4b-3f39-497e-954d-3ac2276a42f0 tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:38 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-20c37d4b-3f39-497e-954d-3ac2276a42f0 tempest-VolumesActionsTest-1308765022 None] Detaching volume d7721919-a046-49b9-9071-5f8126b520c3 from instance 6e74729d-2fe3-4ba6-93bf-051c15cedf74. Apr 15 10:12:38 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-20c37d4b-3f39-497e-954d-3ac2276a42f0 tempest-VolumesActionsTest-1308765022 None] Detach volume completed successfully. Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-20c37d4b-3f39-497e-954d-3ac2276a42f0 tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:38 devstack sudo[88597]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b 1073741824" returned: 0 in 0.683s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:38 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b Apr 15 10:12:38 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:38 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b" returned: 0 in 0.501s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.996s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-104643325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7bafad4-ea53-4203-9518-39c0d005d2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Creating volume f7bafad4-ea53-4203-9518-39c0d005d2ca {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:38 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f63301-5d9f-4305-9704-6a99f9c57514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:39 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca 1073741824 Apr 15 10:12:39 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b4f451-82ac-4c22-b249-a6384cd50782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:39 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b (f3bc5754-cb97-4db1-8dc6-ca8337f4559b): created successfully Apr 15 10:12:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b4f451-82ac-4c22-b249-a6384cd50782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (58b419a8-ba2f-41a5-93f5-e60a07c21885) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:39 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1a7263b7-a8f4-4d87-9116-3e7a7aed060b tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created volume successfully. Apr 15 10:12:39 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca 1073741824" returned: 0 in 0.577s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:39 devstack sudo[88611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca Apr 15 10:12:39 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:40 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca" returned: 0 in 0.508s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.846s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-303345618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb75ed51-9f66-4593-b10d-1061d50ae501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Creating volume eb75ed51-9f66-4593-b10d-1061d50ae501 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:40 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7de2b42f-5a8f-4cde-acc0-f2ed1514a530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7bafad4-ea53-4203-9518-39c0d005d2ca', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:40 devstack sudo[88642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501 1073741824 Apr 15 10:12:40 devstack sudo[88642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98478cf0-949f-45e2-9dfd-78c9cc5e143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:40 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume volume-f7bafad4-ea53-4203-9518-39c0d005d2ca (f7bafad4-ea53-4203-9518-39c0d005d2ca): created successfully Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98478cf0-949f-45e2-9dfd-78c9cc5e143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (ebadb38a-e4c5-4acf-91a9-1476f377b83e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:40 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-af005d87-df4c-4514-8a2f-b552dc3ddccf tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created volume successfully. Apr 15 10:12:40 devstack sudo[88642]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501 1073741824" returned: 0 in 0.707s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:40 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501 Apr 15 10:12:40 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:41 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501" returned: 0 in 0.512s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.877s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2136254497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fad07e50-3f73-4390-9d02-aa592771d1de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='722a16a84ea246ee8462580e60c0c3d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:28Z,use_quota=True,user_id='5ae24aa7fbd047308a42ae26a244fa76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Creating volume fad07e50-3f73-4390-9d02-aa592771d1de {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:41 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65821205-02e6-4f4c-8ce5-9512467b6761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb75ed51-9f66-4593-b10d-1061d50ae501', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:41 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de 1073741824 Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc26cab0-d9a5-4863-9f96-a764e49ad333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:41 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:41 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume volume-eb75ed51-9f66-4593-b10d-1061d50ae501 (eb75ed51-9f66-4593-b10d-1061d50ae501): created successfully Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc26cab0-d9a5-4863-9f96-a764e49ad333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:41 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (ee1674ae-20b9-483d-a97f-c0404aa1958a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:41 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-926f0a4e-27af-4f34-b456-ba1bf5ff0106 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created volume successfully. Apr 15 10:12:42 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de 1073741824" returned: 0 in 0.671s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:42 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de Apr 15 10:12:42 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:42 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de" returned: 0 in 0.479s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.080s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-793120844',display_name='tempest-VolumesGetTest-Volume-1677036496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cb902a1-c53f-4a85-8509-1e43ec01a5a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:37Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Creating volume 0cb902a1-c53f-4a85-8509-1e43ec01a5a4 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:42 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064a49f5-b363-4655-bc97-cf03d7f81cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fad07e50-3f73-4390-9d02-aa592771d1de', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:42 devstack sudo[88662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 1073741824 Apr 15 10:12:42 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9a4da8-f2ac-4798-8d39-6ae929cb9828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:42 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Volume volume-fad07e50-3f73-4390-9d02-aa592771d1de (fad07e50-3f73-4390-9d02-aa592771d1de): created successfully Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f9a4da8-f2ac-4798-8d39-6ae929cb9828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Flow 'volume_create_manager' (e3621762-6f5b-4340-b2ce-1092db2fa2ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:42 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-bdc7b669-082a-4bc0-b6b4-9b7b2b3b7b04 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created volume successfully. Apr 15 10:12:43 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 1073741824" returned: 0 in 0.517s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 Apr 15 10:12:43 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:43 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4" returned: 0 in 0.452s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73ad192-4244-47f8-87c7-35c2e20de493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93154882-7e09-402b-898a-7425feba4917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:43 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Volume volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 (0cb902a1-c53f-4a85-8509-1e43ec01a5a4): created successfully Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93154882-7e09-402b-898a-7425feba4917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (782e76fd-4324-4181-b3cf-113e5aadd736) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:43 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b669f3c9-2902-4894-9a6d-f595300fbc72 tempest-VolumesGetTest-21188703 None] Created volume successfully. Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-fad07e50-3f73-4390-9d02-aa592771d1de-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-fad07e50-3f73-4390-9d02-aa592771d1de-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-quobyte-fad07e50-3f73-4390-9d02-aa592771d1de" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-fad07e50-3f73-4390-9d02-aa592771d1de" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[473be180-eea9-487e-b563-7e4775e09067]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:43 devstack sudo[88670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de Apr 15 10:12:43 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-0cb902a1-c53f-4a85-8509-1e43ec01a5a4-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Lock "cinder-0cb902a1-c53f-4a85-8509-1e43ec01a5a4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-quobyte-0cb902a1-c53f-4a85-8509-1e43ec01a5a4" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-0cb902a1-c53f-4a85-8509-1e43ec01a5a4" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9869888-b554-4153-a4b5-2daff4acc366]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:44 devstack sudo[88672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 Apr 15 10:12:44 devstack sudo[88672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de" returned: 0 in 0.549s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:44 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de Apr 15 10:12:44 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack sudo[88672]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4" returned: 0 in 0.504s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:44 devstack sudo[88682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4 Apr 15 10:12:44 devstack sudo[88682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fad07e50-3f73-4390-9d02-aa592771d1de" returned: 0 in 0.443s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-fad07e50-3f73-4390-9d02-aa592771d1de" released by "delete_volume" :: held 1.024s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created reservations ['c8c67b8e-7637-4d05-8f0a-5aa6b66904f0', '04b04978-0adf-4592-ae45-6f28af960add', 'a4dfa043-bb53-4937-826b-77d8f73d545a', 'e7a293bd-475a-4e11-9511-2fe728de284f'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:44 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:44 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:44 devstack sudo[88682]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0cb902a1-c53f-4a85-8509-1e43ec01a5a4" returned: 0 in 0.461s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-0cb902a1-c53f-4a85-8509-1e43ec01a5a4" released by "delete_volume" :: held 0.998s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Created reservations ['977bab53-1daa-4d6b-b291-5fec71604145', 'd2e0cd67-029f-4e81-b0b2-62eb178e2661', '62ca4194-00e9-4fe9-9fa8-8b7f8b273f51', '7194479a-3a18-4376-b969-ee17bd0ffbdc'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:45 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:45 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:45 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.505s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Deleted volume successfully. Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-1df5406d-32d7-49bb-ad16-e0a75e2a76f0 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-fad07e50-3f73-4390-9d02-aa592771d1de-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:45 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.497s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Deleted volume successfully. Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c7cb5975-9597-4f84-b1dd-0ac4495438ac tempest-VolumesGetTest-21188703 None] Lock "cinder-0cb902a1-c53f-4a85-8509-1e43ec01a5a4-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-eb75ed51-9f66-4593-b10d-1061d50ae501-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-eb75ed51-9f66-4593-b10d-1061d50ae501-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-quobyte-eb75ed51-9f66-4593-b10d-1061d50ae501" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-eb75ed51-9f66-4593-b10d-1061d50ae501" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff360752-44d4-404d-bf33-b6d8933c504b]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:46 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501 Apr 15 10:12:46 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-80fcbd34-ba14-4a70-a991-d6c01aaf02df-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Lock "cinder-80fcbd34-ba14-4a70-a991-d6c01aaf02df-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-quobyte-80fcbd34-ba14-4a70-a991-d6c01aaf02df" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-80fcbd34-ba14-4a70-a991-d6c01aaf02df" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6391b8d2-b193-44e8-a815-e438b5843fa9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:46 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df Apr 15 10:12:46 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:46 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501" returned: 0 in 0.609s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:46 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501 Apr 15 10:12:46 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:46 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df" returned: 0 in 0.556s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:46 devstack sudo[88708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df Apr 15 10:12:46 devstack sudo[88708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:47 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb75ed51-9f66-4593-b10d-1061d50ae501" returned: 0 in 0.495s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-eb75ed51-9f66-4593-b10d-1061d50ae501" released by "delete_volume" :: held 1.129s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created reservations ['f564e53c-b117-46b3-9671-5fb78ee038ec', '6b478e16-abf6-44b7-878d-34f3468709cf', '3d7da113-13cd-408c-894e-316c2f88e8c1', 'e4a0e962-55ed-4e38-ba31-0f6ddc43c9ca'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:47 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:47 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:47 devstack sudo[88708]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80fcbd34-ba14-4a70-a991-d6c01aaf02df" returned: 0 in 0.507s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-80fcbd34-ba14-4a70-a991-d6c01aaf02df" released by "delete_volume" :: held 1.094s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Created reservations ['04940892-6c82-4213-8994-d9d9553b8b66', '6570ba9b-3e7f-4b1e-a266-347a6629d30d', '2617decc-ee9c-46a4-9e22-97a202daf5cd', '64b8639b-4736-4265-a550-b0022a55aed2'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:47 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:47 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:47 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.503s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:47 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Deleted volume successfully. Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa4daf2c-f4fd-4a6c-a213-33d5f6e55d52 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-eb75ed51-9f66-4593-b10d-1061d50ae501-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:47 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.485s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:47 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Deleted volume successfully. Apr 15 10:12:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2834cc13-76da-4b4d-b799-96d2597b9189 tempest-VolumesGetTest-21188703 None] Lock "cinder-80fcbd34-ba14-4a70-a991-d6c01aaf02df-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-f7bafad4-ea53-4203-9518-39c0d005d2ca-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-f7bafad4-ea53-4203-9518-39c0d005d2ca-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-quobyte-f7bafad4-ea53-4203-9518-39c0d005d2ca" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-f7bafad4-ea53-4203-9518-39c0d005d2ca" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb1afde-56f1-4fae-8a50-fa9a6871f837]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca Apr 15 10:12:48 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-b4fc43a3-748c-4a38-97d2-0950ffc97a27-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Lock "cinder-b4fc43a3-748c-4a38-97d2-0950ffc97a27-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-quobyte-b4fc43a3-748c-4a38-97d2-0950ffc97a27" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-b4fc43a3-748c-4a38-97d2-0950ffc97a27" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cbc9a1-8b5d-4946-b0ed-549074b2a2fd]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 Apr 15 10:12:48 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:48 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca" returned: 0 in 0.569s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:48 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca Apr 15 10:12:48 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:49 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27" returned: 0 in 0.525s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:49 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27 Apr 15 10:12:49 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:49 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f7bafad4-ea53-4203-9518-39c0d005d2ca" returned: 0 in 0.443s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-f7bafad4-ea53-4203-9518-39c0d005d2ca" released by "delete_volume" :: held 1.039s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created reservations ['cb1e74c4-f70a-42c4-add9-b791aa51f948', 'bea97222-633c-4bb7-9ddc-6f35a1046a8f', 'fc89fcd6-c46c-43b2-a6c5-038957df3098', 'c15f69de-0d38-48d9-9358-680321a732a0'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:49 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:49 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:49 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b4fc43a3-748c-4a38-97d2-0950ffc97a27" returned: 0 in 0.509s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-b4fc43a3-748c-4a38-97d2-0950ffc97a27" released by "delete_volume" :: held 1.078s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Created reservations ['cd1df51f-533c-4834-9c79-7d073cd6e094', 'ea3e47e7-3413-45a7-81d5-756295f8285e', '0d16736e-431a-47a6-b241-94aa950a6840', '7d98956a-bcb2-4c1e-aa67-be5b14b7c249'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:49 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:49 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:49 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.491s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:49 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Deleted volume successfully. Apr 15 10:12:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-81fc2b86-6a43-4011-a3bb-0452c9475abe tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-f7bafad4-ea53-4203-9518-39c0d005d2ca-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:50 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.485s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:50 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:50 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Deleted volume successfully. Apr 15 10:12:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-46b64a05-75e2-4a37-9501-c6e15bc91bd8 tempest-VolumesGetTest-21188703 None] Lock "cinder-b4fc43a3-748c-4a38-97d2-0950ffc97a27-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-f3bc5754-cb97-4db1-8dc6-ca8337f4559b-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-f3bc5754-cb97-4db1-8dc6-ca8337f4559b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-quobyte-f3bc5754-cb97-4db1-8dc6-ca8337f4559b" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-f3bc5754-cb97-4db1-8dc6-ca8337f4559b" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:50 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bffe19-0681-4245-9a6a-cd1d69f18f88]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:50 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b Apr 15 10:12:50 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (a27944a4-6afa-4696-9995-6a70167025da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4072442-465f-4134-baa9-a2eb090e34eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4072442-465f-4134-baa9-a2eb090e34eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1791591388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8037dc3-4497-40e6-b32f-cabdebb5c36d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:51Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9067ec5d-34cb-49a9-bffe-11ceeae6d9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9067ec5d-34cb-49a9-bffe-11ceeae6d9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f5db0e-89fc-4492-865a-2363b653d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.image.glance [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Creating Keystone auth plugin from conf {{(pid=82600) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 15 10:12:51 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b" returned: 0 in 0.733s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:51 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b Apr 15 10:12:51 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f5db0e-89fc-4492-865a-2363b653d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8037dc3-4497-40e6-b32f-cabdebb5c36d', 'volume_name': 'volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d8b028-30bb-4fe2-a1a6-3a199d117bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d8b028-30bb-4fe2-a1a6-3a199d117bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b4e96a-34d5-43be-b97b-aca3263068ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:51 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Volume d8037dc3-4497-40e6-b32f-cabdebb5c36d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Trying to clone d8037dc3-4497-40e6-b32f-cabdebb5c36d from image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]). {{(pid=82600) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 15 10:12:51 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Image download 20.69 MB at 20.69 MB/s Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f049cd16-b6ce-4e90-83cd-ad971d3b8882]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:51 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f3bc5754-cb97-4db1-8dc6-ca8337f4559b" returned: 0 in 0.591s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-f3bc5754-cb97-4db1-8dc6-ca8337f4559b" released by "delete_volume" :: held 1.354s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:51 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD Apr 15 10:12:51 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created reservations ['555d30db-a880-42c0-b283-c01e30d72dc1', '6dfa5d0d-e927-406d-8465-8b31c4117ec6', '2b84ee60-199f-43c7-95c1-db900f38c37d', '602a1358-e5f0-49a5-97be-861e249c219e'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:51 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:51 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:52 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD" returned: 0 in 0.556s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Temporary image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 is fetched for user 4c5af2d012354a21b0489c446889c8d3. {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630e7ee-381b-4330-b113-02ac125119d7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:52 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:52 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Deleted volume successfully. Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-17ac294a-1f59-43bd-b968-0a238b291672 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-f3bc5754-cb97-4db1-8dc6-ca8337f4559b-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:52 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD Apr 15 10:12:52 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-cd2a3011-c9b4-4dea-b3b2-114031263a76-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-cd2a3011-c9b4-4dea-b3b2-114031263a76-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-quobyte-cd2a3011-c9b4-4dea-b3b2-114031263a76" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-cd2a3011-c9b4-4dea-b3b2-114031263a76" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8800f465-c061-4ff7-9d72-0d4472e2cb39]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:52 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 Apr 15 10:12:52 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:52 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD" returned: 0 in 0.597s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1791591388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8037dc3-4497-40e6-b32f-cabdebb5c36d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:51Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Creating volume d8037dc3-4497-40e6-b32f-cabdebb5c36d {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:52 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:52 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d 1073741824 Apr 15 10:12:52 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:53 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76" returned: 0 in 0.527s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76 Apr 15 10:12:53 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:53 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d 1073741824" returned: 0 in 0.557s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[88798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d Apr 15 10:12:53 devstack sudo[88798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:53 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-cd2a3011-c9b4-4dea-b3b2-114031263a76" returned: 0 in 0.536s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-cd2a3011-c9b4-4dea-b3b2-114031263a76" released by "delete_volume" :: held 1.094s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created reservations ['a5e6c556-6be1-4de7-9179-5b7802d1181e', 'b7925f35-7f12-48ad-9fe5-36d0bdebd3bf', '542ad7ab-2fc3-4b97-ad66-67fa900c5561', '9d4b4ce8-6e3f-4173-b312-dbcfadbdd963'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:53 devstack sudo[88801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:53 devstack sudo[88801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:54 devstack sudo[88798]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d" returned: 0 in 0.544s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Attempting download of 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}])) to volume d8037dc3-4497-40e6-b32f-cabdebb5c36d. {{(pid=82600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1518e115-6088-4e5c-9190-7bf3298c5880]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_spt8801b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:54 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_spt8801b Apr 15 10:12:54 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:54 devstack sudo[88801]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.554s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:54 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Deleted volume successfully. Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aa443c51-70a6-4d65-924c-c9b73ade3dd1 tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-cd2a3011-c9b4-4dea-b3b2-114031263a76-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:54 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_spt8801b" returned: 0 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_spt8801b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:54 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_spt8801b Apr 15 10:12:54 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-eb20b668-3aef-4ad0-8414-ad6c7cf97069-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-eb20b668-3aef-4ad0-8414-ad6c7cf97069-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "cinder-quobyte-eb20b668-3aef-4ad0-8414-ad6c7cf97069" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-eb20b668-3aef-4ad0-8414-ad6c7cf97069" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff776c49-00f2-45e0-8c89-ee8e619e3c69]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:54 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 Apr 15 10:12:54 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:55 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_spt8801b" returned: 1 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_spt8801b' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[981b4dad-c101-4ed7-9772-ccb38bda0794]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:55 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD Apr 15 10:12:55 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:55 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069" returned: 0 in 0.559s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:55 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069 Apr 15 10:12:55 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:55 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD" returned: 0 in 0.540s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 was qcow2, converting to raw {{(pid=82600) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:55 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d Apr 15 10:12:55 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:55 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-eb20b668-3aef-4ad0-8414-ad6c7cf97069" returned: 0 in 0.462s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-quobyte-eb20b668-3aef-4ad0-8414-ad6c7cf97069" released by "delete_volume" :: held 1.049s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Created reservations ['b45af5b8-03cb-4d07-badd-8786d705f1b0', '99cad3e0-c5c1-4ddb-8939-3894839efa01', 'bfd69f83-6645-4e11-bcde-3fb607c36f0f', '0ebef9cc-cf51-45c7-ba4d-a676af5e9dda'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:56 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:12:56 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:56 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.542s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:56 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:12:56 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Deleted volume successfully. Apr 15 10:12:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-135e3673-b286-4bb6-a461-b8a2841dc68a tempest-CreateVolumesFromSourceVolumeTest-62422857 None] Lock "cinder-eb20b668-3aef-4ad0-8414-ad6c7cf97069-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:56 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d" returned: 0 in 1.050s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:56 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4_87q88ltvdevstack@QuobyteHD, size 112.00 MB, duration 1.05 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:12:56 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Converted 112.00 MB image at 106.37 MB/s Apr 15 10:12:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:56 devstack sudo[88852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d 1G Apr 15 10:12:56 devstack sudo[88852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:57 devstack sudo[88852]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d 1G" returned: 0 in 0.645s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:57 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1fed18-1c85-4cf0-afc4-a68ce7c6e690]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:12:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:57 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d Apr 15 10:12:57 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:58 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d" returned: 0 in 0.629s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:58 devstack sudo[88885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d Apr 15 10:12:58 devstack sudo[88885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:58 devstack sudo[88885]: pam_unix(sudo:session): session closed for user root Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d" returned: 1 in 0.710s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Downloaded image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 ((None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}])) to volume d8037dc3-4497-40e6-b32f-cabdebb5c36d successfully. {{(pid=82600) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Temporary image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 for user 4c5af2d012354a21b0489c446889c8d3 is deleted. {{(pid=82600) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG cinder.volume.volume_utils [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Marking volume d8037dc3-4497-40e6-b32f-cabdebb5c36d as bootable. {{(pid=82600) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Copying metadata from image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 to d8037dc3-4497-40e6-b32f-cabdebb5c36d. {{(pid=82600) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Creating volume glance metadata for volume d8037dc3-4497-40e6-b32f-cabdebb5c36d backed by image 72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82600) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81b4e96a-34d5-43be-b97b-aca3263068ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d', 'volume_size': 1, 'image_id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2dbf9696958441a4802b53933a4546c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4', 'created_at': datetime.datetime(2026, 4, 15, 8, 1, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 15, 8, 1, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/72c01ff0-3ba6-4c5f-aca3-ca94bcf900e4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8b4f9b-7755-4722-834f-8e12b8bdf657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:58 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Volume volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d (d8037dc3-4497-40e6-b32f-cabdebb5c36d): created successfully Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8b4f9b-7755-4722-834f-8e12b8bdf657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:58 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (a27944a4-6afa-4696-9995-6a70167025da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-95becab5-a85e-4e87-b157-30497b65b3ca tempest-VolumesGetTest-21188703 None] Created volume successfully. Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-182ff198-2b47-4c8d-8e46-d027ecdc334e tempest-VolumesActionsTest-1308765022 None] Acquiring lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3" by "attach_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-182ff198-2b47-4c8d-8e46-d027ecdc334e tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3" acquired by "attach_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:59 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-182ff198-2b47-4c8d-8e46-d027ecdc334e tempest-VolumesActionsTest-1308765022 None] Attaching volume d7721919-a046-49b9-9071-5f8126b520c3 to instance 19f75635-7137-4c72-b577-9aacf993d7fb at mountpoint /dev/vdb on host None. Apr 15 10:12:59 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-182ff198-2b47-4c8d-8e46-d027ecdc334e tempest-VolumesActionsTest-1308765022 None] Attach volume completed successfully. Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-182ff198-2b47-4c8d-8e46-d027ecdc334e tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3" released by "attach_volume" :: held 0.064s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Flow 'volume_create_manager' (1a240f8f-8565-42a9-a3bb-983937f605d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496310e4-6b2c-4fb9-8334-73fb609f751c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496310e4-6b2c-4fb9-8334-73fb609f751c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-152604697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d25d8b-152e-400f-afdd-a23c98ad83ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54171c322dfd46af9686beb3e4993811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:59Z,use_quota=True,user_id='412570e3ed56430aa27472509045d34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5e688e-093b-4f62-889b-33c61b6b6763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d5e688e-093b-4f62-889b-33c61b6b6763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261f1de6-6d3e-4289-a259-d3b466845c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (261f1de6-6d3e-4289-a259-d3b466845c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d25d8b-152e-400f-afdd-a23c98ad83ca', 'volume_name': 'volume-75d25d8b-152e-400f-afdd-a23c98ad83ca', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78773a6e-dfa8-4d47-a40e-f014106566e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78773a6e-dfa8-4d47-a40e-f014106566e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51751aa8-43c7-40c9-8bd4-259b9001527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:12:59 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Volume 75d25d8b-152e-400f-afdd-a23c98ad83ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d25d8b-152e-400f-afdd-a23c98ad83ca', 'volume_size': 1} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-152604697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d25d8b-152e-400f-afdd-a23c98ad83ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54171c322dfd46af9686beb3e4993811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:12:59Z,use_quota=True,user_id='412570e3ed56430aa27472509045d34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Creating volume 75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:12:59 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:12:59 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca 1073741824 Apr 15 10:12:59 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-30479689-93ba-48e3-a159-749f10df4239 tempest-VolumesActionsTest-1308765022 None] Acquiring lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3-detach_volume" by "detach_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-30479689-93ba-48e3-a159-749f10df4239 tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:12:59 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-30479689-93ba-48e3-a159-749f10df4239 tempest-VolumesActionsTest-1308765022 None] Detaching volume d7721919-a046-49b9-9071-5f8126b520c3 from instance 19f75635-7137-4c72-b577-9aacf993d7fb. Apr 15 10:12:59 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-30479689-93ba-48e3-a159-749f10df4239 tempest-VolumesActionsTest-1308765022 None] Detach volume completed successfully. Apr 15 10:12:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-30479689-93ba-48e3-a159-749f10df4239 tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (f3ad56fb-f75c-47de-b653-8a21488e2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0623f52-b1e2-4e59-ab18-271c3b92d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0623f52-b1e2-4e59-ab18-271c3b92d44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-605078311',display_name='tempest-VolumesGetTest-Volume-993938106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:00Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdf79d1-f966-45e8-8d27-7cc994851360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbdf79d1-f966-45e8-8d27-7cc994851360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47cd0a8-66e5-4403-8057-bca131ed1aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47cd0a8-66e5-4403-8057-bca131ed1aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1', 'volume_name': 'volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf55ee7-6c26-45a2-b7ae-d0433b7de1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf55ee7-6c26-45a2-b7ae-d0433b7de1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c64f678-1cd1-4c16-a698-d5d441b1ad76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:00 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Volume 8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1', 'volume_size': 1} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:00 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca 1073741824" returned: 0 in 0.712s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca Apr 15 10:13:00 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:00 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca" returned: 0 in 0.511s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.619s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-605078311',display_name='tempest-VolumesGetTest-Volume-993938106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58278122c47d4dadbc7439f4ee0cbc25',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:00Z,use_quota=True,user_id='4c5af2d012354a21b0489c446889c8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Creating volume 8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:00 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51751aa8-43c7-40c9-8bd4-259b9001527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d25d8b-152e-400f-afdd-a23c98ad83ca', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:00 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 1073741824 Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d721de7-9eaf-4741-a7e0-346afed5d690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:00 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:00 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Volume volume-75d25d8b-152e-400f-afdd-a23c98ad83ca (75d25d8b-152e-400f-afdd-a23c98ad83ca): created successfully Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d721de7-9eaf-4741-a7e0-346afed5d690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Flow 'volume_create_manager' (1a240f8f-8565-42a9-a3bb-983937f605d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-76a9df13-46a3-4204-8fb0-c1cc3b1e4f92 tempest-VolumeDependencyTests-1344590227 None] Created volume successfully. Apr 15 10:13:01 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 1073741824" returned: 0 in 0.579s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:01 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 Apr 15 10:13:01 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:01 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1" returned: 0 in 0.558s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.143s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c64f678-1cd1-4c16-a698-d5d441b1ad76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598a45b8-fc4e-4d90-a71d-96a36e2015bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Creating offline snapshot 93146a92-31cf-43e5-a606-1df9549284e1 of volume 75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:13:01 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Volume volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 (8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1): created successfully Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598a45b8-fc4e-4d90-a71d-96a36e2015bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Flow 'volume_create_manager' (f3ad56fb-f75c-47de-b653-8a21488e2929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe691b59-44f2-4d44-8fd7-68c30f187515]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:02 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2ee86998-e1ba-4c37-b2dc-63384e5ca978 tempest-VolumesGetTest-21188703 None] Created volume successfully. Apr 15 10:13:02 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca Apr 15 10:13:02 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Lock "cinder-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-quobyte-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f0f3bb-53ef-43b4-9128-4f7877d092cb]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:02 devstack sudo[88981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 Apr 15 10:13:02 devstack sudo[88981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:02 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca" returned: 0 in 0.572s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:02 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 1G Apr 15 10:13:02 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:02 devstack sudo[88981]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1" returned: 0 in 0.578s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:03 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1 Apr 15 10:13:03 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:03 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 1G" returned: 0 in 0.552s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d25d8b-152e-400f-afdd-a23c98ad83ca -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:03 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d25d8b-152e-400f-afdd-a23c98ad83ca -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 Apr 15 10:13:03 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:03 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1" returned: 0 in 0.507s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1" released by "delete_volume" :: held 1.129s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Created reservations ['35b0863c-b280-4037-93d8-9336677e55fd', 'c7d3c5de-a727-4332-ae4e-7ab2612e8d5c', 'c8b48934-6d4c-4506-af10-4bc9824802c7', '5d83fd29-6a3e-4817-9642-6fba9dde5c1c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:03 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:13:03 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:03 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75d25d8b-152e-400f-afdd-a23c98ad83ca -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1" returned: 0 in 0.558s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:03 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 is being set with open permissions: ugo+rw Apr 15 10:13:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:03 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 Apr 15 10:13:03 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:04 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.432s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Deleted volume successfully. Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-78386146-932c-4969-8f27-01e6a14a602c tempest-VolumesGetTest-21188703 None] Lock "cinder-8ecb5d28-de35-4ad5-b399-d9bd2ec2a6e1-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:04 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1" returned: 0 in 0.442s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:04 devstack sudo[89010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.info Apr 15 10:13:04 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-d8037dc3-4497-40e6-b32f-cabdebb5c36d-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Lock "cinder-d8037dc3-4497-40e6-b32f-cabdebb5c36d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:04 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Acquiring lock "cinder-quobyte-d8037dc3-4497-40e6-b32f-cabdebb5c36d" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.info" returned: 0 in 0.489s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:04 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.info is being set with open permissions: ugo+rw Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-d8037dc3-4497-40e6-b32f-cabdebb5c36d" acquired by "delete_volume" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:04 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.info Apr 15 10:13:04 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb737442-96bf-4fd6-83ab-915df2b526d7]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:04 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d Apr 15 10:13:04 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:05 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.info" returned: 0 in 0.452s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.151s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:05 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-5e72b503-0b99-402a-b2c1-714be605f045 tempest-VolumeDependencyTests-1344590227 None] Create snapshot completed successfully Apr 15 10:13:05 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d" returned: 0 in 0.490s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:05 devstack sudo[89020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d Apr 15 10:13:05 devstack sudo[89020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:05 devstack sudo[89020]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d" returned: 1 in 0.498s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:13:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:05 devstack sudo[89025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d Apr 15 10:13:05 devstack sudo[89025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:06 devstack sudo[89025]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d8037dc3-4497-40e6-b32f-cabdebb5c36d" returned: 0 in 0.481s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Lock "cinder-quobyte-d8037dc3-4497-40e6-b32f-cabdebb5c36d" released by "delete_volume" :: held 1.518s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Created reservations ['15efcf2c-fabe-476b-8402-8bbbdcc2cc6b', '6e30fd56-d605-41bd-ba2a-1df3f5829356', '64a59496-b9fc-4e4a-a9db-3f908a8fb47b', 'eff45388-25cf-4659-833e-1408641f6f4c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:06 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:13:06 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Flow 'volume_create_manager' (cf7bbf4a-2030-4960-a279-42736ad2b3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5a7e5c-5cac-47f7-9e7b-676f66acafee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5a7e5c-5cac-47f7-9e7b-676f66acafee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-746954558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3bc2a7-f188-4f87-87f4-abef1251ac8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54171c322dfd46af9686beb3e4993811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93146a92-31cf-43e5-a606-1df9549284e1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:06Z,use_quota=True,user_id='412570e3ed56430aa27472509045d34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46181ed-812e-4cd9-95bc-e691297aeb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46181ed-812e-4cd9-95bc-e691297aeb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ceb326-a490-47d5-a163-cd7824a06a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2ceb326-a490-47d5-a163-cd7824a06a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ef3bc2a7-f188-4f87-87f4-abef1251ac8e', 'volume_name': 'volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e', 'volume_size': 1, 'snapshot_id': '93146a92-31cf-43e5-a606-1df9549284e1'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22907be-bbd5-47df-afc3-f401aeda7c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e22907be-bbd5-47df-afc3-f401aeda7c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0bbc93-17ae-43e5-8139-814ce191be82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:06 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Volume ef3bc2a7-f188-4f87-87f4-abef1251ac8e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e', 'volume_size': 1, 'snapshot_id': '93146a92-31cf-43e5-a606-1df9549284e1'} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-93146a92-31cf-43e5-a606-1df9549284e1-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" by "_create_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-93146a92-31cf-43e5-a606-1df9549284e1-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Creating volume ef3bc2a7-f188-4f87-87f4-abef1251ac8e from snapshot 93146a92-31cf-43e5-a606-1df9549284e1 {{(pid=82600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] snapshot: 93146a92-31cf-43e5-a606-1df9549284e1, volume: ef3bc2a7-f188-4f87-87f4-abef1251ac8e, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06af68c-0100-4a4f-acff-d4785f65997e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:06 devstack sudo[89030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 Apr 15 10:13:06 devstack sudo[89030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:07 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.719s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:07 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Deleted volume successfully. Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e3b65cb1-6bcc-4926-a285-247d02bb2942 tempest-VolumesGetTest-21188703 None] Lock "cinder-d8037dc3-4497-40e6-b32f-cabdebb5c36d-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:07 devstack sudo[89030]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1" returned: 0 in 0.707s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d25d8b-152e-400f-afdd-a23c98ad83ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[be738bc5-f5e1-468d-86ba-7378957f28ab]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:07 devstack sudo[89036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca Apr 15 10:13:07 devstack sudo[89036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:07 devstack sudo[89036]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca" returned: 0 in 0.640s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:13:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:07 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e Apr 15 10:13:07 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:10 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" returned: 0 in 2.380s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[08356a8a-e3de-468b-877d-6463e3143a23]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:10 devstack sudo[89053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:13:10 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:10 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca Apr 15 10:13:10 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:10 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.561s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:10 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca" returned: 0 in 0.727s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca, size 1024.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:13:10 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Converted 1024.00 MB image at 429.89 MB/s Apr 15 10:13:10 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e is being set with open permissions: ugo+rw Apr 15 10:13:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:10 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e Apr 15 10:13:10 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:11 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" returned: 0 in 0.527s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" released by "_copy_volume_from_snapshot" :: held 5.075s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-93146a92-31cf-43e5-a606-1df9549284e1-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" released by "_create_volume_from_snapshot" :: held 5.098s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.111s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.235s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e5ae42-37f0-4bb6-b87b-56b66a1fcf39]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:DELETE=23,cinder:SELECT=157,cinder:INSERT=62,cinder:UPDATE=208 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0bbc93-17ae-43e5-8139-814ce191be82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e', 'volume_size': 1, 'snapshot_id': '93146a92-31cf-43e5-a606-1df9549284e1'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b26f5f0-b670-409d-8130-e1032049e438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:11 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Volume volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e (ef3bc2a7-f188-4f87-87f4-abef1251ac8e): created successfully Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b26f5f0-b670-409d-8130-e1032049e438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Flow 'volume_create_manager' (cf7bbf4a-2030-4960-a279-42736ad2b3bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:11 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f5854ea1-78f9-46fd-b580-0bee251ff046 tempest-VolumeDependencyTests-1344590227 None] Created volume successfully. Apr 15 10:13:11 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 Apr 15 10:13:11 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-93146a92-31cf-43e5-a606-1df9549284e1-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-93146a92-31cf-43e5-a606-1df9549284e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-75d25d8b-152e-400f-afdd-a23c98ad83ca" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-75d25d8b-152e-400f-afdd-a23c98ad83ca" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-93146a92-31cf-43e5-a606-1df9549284e1" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-93146a92-31cf-43e5-a606-1df9549284e1" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Deleting offline snapshot 93146a92-31cf-43e5-a606-1df9549284e1 of volume 75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] snapshot_file for this snap is: volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[004c1071-519b-4172-a2a3-0bba1be7e104]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:11 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 Apr 15 10:13:11 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:12 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3" returned: 0 in 0.616s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:12 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a5e41-923f-4b6c-aeef-f5a2375e64ed]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:12 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 Apr 15 10:13:12 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:12 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1" returned: 0 in 0.613s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75d25d8b-152e-400f-afdd-a23c98ad83ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:12 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d6b6e7-d138-47d0-8109-55e8f8396875]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:12 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca Apr 15 10:13:12 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:12 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3" returned: 0 in 0.571s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.77c364a4-5ba1-4c6f-a90d-7ceb4cd6b34ai02landf.img {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:12 devstack sudo[89082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.77c364a4-5ba1-4c6f-a90d-7ceb4cd6b34ai02landf.img Apr 15 10:13:12 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:13 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca" returned: 0 in 0.605s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:13 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 Apr 15 10:13:13 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:14 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1" returned: 0 in 1.087s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:14 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1 Apr 15 10:13:14 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:15 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca.93146a92-31cf-43e5-a606-1df9549284e1" returned: 0 in 0.988s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-93146a92-31cf-43e5-a606-1df9549284e1" released by "_delete_snapshot" :: held 3.358s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:15 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-75d25d8b-152e-400f-afdd-a23c98ad83ca" released by "delete_snapshot" :: held 3.389s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.77c364a4-5ba1-4c6f-a90d-7ceb4cd6b34ai02landf.img" returned: 0 in 2.451s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ef92e8-7eac-41ad-a9d4-56125c48da69]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Created reservations ['e533aaec-607b-4901-9e22-629d933fd9fc', 'ca10addf-1c8d-491c-bf0a-c781f0f6929c', '7a7563da-4819-48c0-b9fd-55380e0a5c46', 'e5b55115-79a5-45b8-ac14-8aa1212549ea'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:15 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 Apr 15 10:13:15 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:15 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Delete snapshot completed successfully. Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-38a02e2d-24a2-4ce7-a8fe-9f7fab9c3dc9 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-93146a92-31cf-43e5-a606-1df9549284e1-delete_snapshot" released by "delete_snapshot" :: held 3.556s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:15 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3" returned: 0 in 0.675s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3, size 1024.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.77c364a4-5ba1-4c6f-a90d-7ceb4cd6b34ai02landf.img {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:13:15 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Converted 1024.00 MB image at 417.59 MB/s Apr 15 10:13:15 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] 77c364a4-5ba1-4c6f-a90d-7ceb4cd6b34a was raw, no need to convert to raw {{(pid=82600) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 15 10:13:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-75d25d8b-152e-400f-afdd-a23c98ad83ca-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-75d25d8b-152e-400f-afdd-a23c98ad83ca-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-75d25d8b-152e-400f-afdd-a23c98ad83ca" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-75d25d8b-152e-400f-afdd-a23c98ad83ca" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:16 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edb8acc-6106-46d7-a710-0a49f90e1430]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:16 devstack sudo[89110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca Apr 15 10:13:16 devstack sudo[89110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:16 devstack sudo[89110]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca" returned: 0 in 0.616s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:16 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca Apr 15 10:13:16 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:17 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-75d25d8b-152e-400f-afdd-a23c98ad83ca" returned: 0 in 0.642s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-75d25d8b-152e-400f-afdd-a23c98ad83ca" released by "delete_volume" :: held 1.299s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:17 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Created reservations ['f0253a1b-335a-4d9e-8113-452c8fd0e2f6', '7213833e-b8c6-4254-8cb1-0fd6102c555f', '649af6de-ff85-4107-ac41-44ec27159dde', '29041400-b05e-4241-b81a-e67568bc9f4b'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:17 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:13:17 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:18 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.612s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:18 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Deleted volume successfully. Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4545c742-9984-449a-ac10-1609687045ae tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-75d25d8b-152e-400f-afdd-a23c98ad83ca-delete_volume" released by "delete_volume" :: held 2.095s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Flow 'volume_create_manager' (83102e8a-8c34-43bc-ae05-b9e6c0ee8b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31752390-4cc3-42cc-ad52-acbae789ec01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31752390-4cc3-42cc-ad52-acbae789ec01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1966212945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a0c546-d2bb-4fce-937d-c7dedfcc67e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54171c322dfd46af9686beb3e4993811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:19Z,use_quota=True,user_id='412570e3ed56430aa27472509045d34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a6caad-86c9-4e11-8b92-4c14595a16e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a6caad-86c9-4e11-8b92-4c14595a16e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c872ba-7517-4916-956f-32921b7d2401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c872ba-7517-4916-956f-32921b7d2401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a0c546-d2bb-4fce-937d-c7dedfcc67e4', 'volume_name': 'volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58670f9-9e32-4b35-900c-ab312c1120c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58670f9-9e32-4b35-900c-ab312c1120c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a63fb7-9fa5-4b3f-b8b8-67542823b33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:18 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Volume 61a0c546-d2bb-4fce-937d-c7dedfcc67e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4', 'volume_size': 1} Apr 15 10:13:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (ad5ecc58-3099-4dec-8c62-842fee72c13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461a5b2f-6852-40da-84b5-12c46bc5e494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (461a5b2f-6852-40da-84b5-12c46bc5e494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1308212449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ab5c98-12d1-436a-9a09-dc67fbcc8668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500ee3210a204e27989ecff66a868fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:20Z,use_quota=True,user_id='1aa18c1b53444010a644a06d66ec4ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee7cb7e-c28a-4cad-8338-a16744c8841d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee7cb7e-c28a-4cad-8338-a16744c8841d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc1e3a9-1394-4621-857a-73e57e01df08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc1e3a9-1394-4621-857a-73e57e01df08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12ab5c98-12d1-436a-9a09-dc67fbcc8668', 'volume_name': 'volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c06e72c-d491-42bf-bf63-ded6e72c5477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c06e72c-d491-42bf-bf63-ded6e72c5477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a0b6b8-daea-4404-a52d-be2e699d31e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:20 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Volume 12ab5c98-12d1-436a-9a09-dc67fbcc8668: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668', 'volume_size': 1} Apr 15 10:13:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 15.220s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Uploaded volume to glance image-id: 77c364a4-5ba1-4c6f-a90d-7ceb4cd6b34a. {{(pid=82600) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.994s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1966212945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a0c546-d2bb-4fce-937d-c7dedfcc67e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54171c322dfd46af9686beb3e4993811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:19Z,use_quota=True,user_id='412570e3ed56430aa27472509045d34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Creating volume 61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:26 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:13:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:26 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 1073741824 Apr 15 10:13:26 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:26 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2f7edf07-32c6-4519-8216-57778639b2d0 tempest-VolumesActionsTest-1308765022 None] Copy volume to image completed successfully. Apr 15 10:13:27 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 1073741824" returned: 0 in 0.630s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:UPDATE=169,cinder:SELECT=120,cinder:DELETE=10,cinder:INSERT=31 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:27 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 Apr 15 10:13:27 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:27 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" returned: 0 in 0.454s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.273s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1308212449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12ab5c98-12d1-436a-9a09-dc67fbcc8668,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500ee3210a204e27989ecff66a868fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:20Z,use_quota=True,user_id='1aa18c1b53444010a644a06d66ec4ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Creating volume 12ab5c98-12d1-436a-9a09-dc67fbcc8668 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:27 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03a63fb7-9fa5-4b3f-b8b8-67542823b33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:27 devstack sudo[89131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 1073741824 Apr 15 10:13:27 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aa0c34-8ce2-4ca4-b1d7-0f4f376ecf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:27 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Volume volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 (61a0c546-d2bb-4fce-937d-c7dedfcc67e4): created successfully Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66aa0c34-8ce2-4ca4-b1d7-0f4f376ecf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Flow 'volume_create_manager' (83102e8a-8c34-43bc-ae05-b9e6c0ee8b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:27 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1399b31d-748d-4b82-934c-9b8bfc15f7f2 tempest-VolumeDependencyTests-1344590227 None] Created volume successfully. Apr 15 10:13:28 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 1073741824" returned: 0 in 0.581s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:28 devstack sudo[89136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 Apr 15 10:13:28 devstack sudo[89136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Flow 'volume_create_manager' (49cf0226-ce81-4d89-83bf-9f3b6d5c5d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756f84f2-562a-4827-8e9f-db1ab0e07ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (756f84f2-562a-4827-8e9f-db1ab0e07ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1083012777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b3037d-3c6d-4a20-9426-102a92aca261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54171c322dfd46af9686beb3e4993811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=61a0c546-d2bb-4fce-937d-c7dedfcc67e4,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:28Z,use_quota=True,user_id='412570e3ed56430aa27472509045d34f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668ebc3a-ace6-4e7f-a2fd-b77b1575d6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (668ebc3a-ace6-4e7f-a2fd-b77b1575d6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab1ba86-06c1-48c5-b235-00c4535de527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab1ba86-06c1-48c5-b235-00c4535de527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '57b3037d-3c6d-4a20-9426-102a92aca261', 'volume_name': 'volume-57b3037d-3c6d-4a20-9426-102a92aca261', 'volume_size': 1, 'source_volid': '61a0c546-d2bb-4fce-937d-c7dedfcc67e4', 'source_volstatus': 'available'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6dd7c9-d57a-4c47-9c86-6b048c850735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc6dd7c9-d57a-4c47-9c86-6b048c850735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd152bb-3165-41c7-b5d4-5f41bfc5d0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:28 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Volume 57b3037d-3c6d-4a20-9426-102a92aca261: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-57b3037d-3c6d-4a20-9426-102a92aca261', 'volume_size': 1, 'source_volid': '61a0c546-d2bb-4fce-937d-c7dedfcc67e4', 'source_volstatus': 'available'} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:28 devstack sudo[89136]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668" returned: 0 in 0.444s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.369s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a0b6b8-daea-4404-a52d-be2e699d31e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2600a4d-854d-4b01-bbc9-df38bd27b802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db663ae-02f9-447e-a7e5-36af2dcdad78]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:28 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Volume volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 (12ab5c98-12d1-436a-9a09-dc67fbcc8668): created successfully Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2600a4d-854d-4b01-bbc9-df38bd27b802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (ad5ecc58-3099-4dec-8c62-842fee72c13d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:28 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8060802a-29b9-4015-af31-0390e2eccd75 tempest-VolumesSnapshotTestJSON-355705279 None] Created volume successfully. Apr 15 10:13:29 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 Apr 15 10:13:29 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:29 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3" returned: 0 in 0.495s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:29 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[111464aa-827e-44b3-8acc-aed38610e4eb]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:29 devstack sudo[89144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 Apr 15 10:13:29 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:29 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3" returned: 0 in 0.547s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:30 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img Apr 15 10:13:30 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:32 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img" returned: 0 in 2.205s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:32 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[169e605e-f01c-4c33-a133-ea8ea2d41bab]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:32 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 Apr 15 10:13:32 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:32 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3" returned: 0 in 0.677s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:32 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:13:32 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Converted 1024.00 MB image at 464.25 MB/s Apr 15 10:13:32 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] 2ee9118b-3c19-4fbb-885f-df63fa8d78a5 was raw, converting to qcow2 {{(pid=82600) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 15 10:13:32 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3915f43d-5c8a-4da2-aed9-394699ccd8d1]: (4, 'raw') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:32 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img Apr 15 10:13:32 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:33 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img" returned: 0 in 0.486s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:33 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img Apr 15 10:13:33 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:33 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img" returned: 1 in 0.473s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img' failed. Not Retrying. {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 15 10:13:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img /opt/stack/data/cinder/conversion/vol_upload_4l7bc7yd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:33 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img /opt/stack/data/cinder/conversion/vol_upload_4l7bc7yd Apr 15 10:13:33 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:34 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img /opt/stack/data/cinder/conversion/vol_upload_4l7bc7yd" returned: 0 in 0.444s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:34 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Image conversion details: src /opt/stack/data/cinder/conversion/d7721919-a046-49b9-9071-5f8126b520c3.temp_image.2ee9118b-3c19-4fbb-885f-df63fa8d78a53iire3bi.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_4l7bc7yd {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:13:34 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 15 10:13:34 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec63251-ea5f-4e11-808c-c70842cc6323]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4l7bc7yd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:34 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4l7bc7yd Apr 15 10:13:34 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:34 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_4l7bc7yd" returned: 0 in 0.462s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.742s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:35 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Uploaded volume to glance image-id: 2ee9118b-3c19-4fbb-885f-df63fa8d78a5. {{(pid=82600) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 15 10:13:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 7.080s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:35 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Cloning volume 61a0c546-d2bb-4fce-937d-c7dedfcc67e4 to volume 57b3037d-3c6d-4a20-9426-102a92aca261 Apr 15 10:13:35 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e4bef035-dbc7-49f9-a24b-46a0adab52e0 tempest-VolumesActionsTest-1308765022 None] Copy volume to image completed successfully. Apr 15 10:13:35 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Creating offline snapshot 4ffc1652-5712-4687-b902-96d7f00bbe8f of volume 61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:13:35 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eb0a9d-9ba1-4a96-914f-99ae191a434a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:35 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 Apr 15 10:13:35 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:36 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" returned: 0 in 0.505s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:36 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f 1G Apr 15 10:13:36 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Acquiring lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Acquiring lock "cinder-quobyte-d7721919-a046-49b9-9071-5f8126b520c3" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Lock "cinder-quobyte-d7721919-a046-49b9-9071-5f8126b520c3" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[467c7074-410a-49ec-b784-b53aa40842a0]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:36 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 Apr 15 10:13:36 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:36 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f 1G" returned: 0 in 0.557s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:36 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f Apr 15 10:13:36 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:36 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3" returned: 0 in 0.536s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:36 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3 Apr 15 10:13:36 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:37 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f" returned: 0 in 0.485s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:37 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f is being set with open permissions: ugo+rw Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:37 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f Apr 15 10:13:37 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:37 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d7721919-a046-49b9-9071-5f8126b520c3" returned: 0 in 0.515s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Lock "cinder-quobyte-d7721919-a046-49b9-9071-5f8126b520c3" released by "delete_volume" :: held 1.086s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Created reservations ['b9690b89-81bb-4e7d-bf4c-a2f2c8f8e4a9', 'e6802262-f62a-4c12-936d-6d35cb832b69', 'd56e4622-ef9a-4487-a468-5a27c48c0246', 'abe0a363-a018-4b1d-baac-3bb54317d866'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:37 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:13:37 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:37 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f" returned: 0 in 0.490s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:37 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.info Apr 15 10:13:37 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:37 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.443s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:37 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Deleted volume successfully. Apr 15 10:13:37 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-aba2a1cb-9246-4e2c-a4a1-a98fbab235f8 tempest-VolumesActionsTest-1308765022 None] Lock "cinder-d7721919-a046-49b9-9071-5f8126b520c3-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:38 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.info" returned: 0 in 0.480s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:38 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.info is being set with open permissions: ugo+rw Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:38 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.info Apr 15 10:13:38 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:38 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.info" returned: 0 in 0.496s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-57b3037d-3c6d-4a20-9426-102a92aca261" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-57b3037d-3c6d-4a20-9426-102a92aca261" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] snapshot: 4ffc1652-5712-4687-b902-96d7f00bbe8f, volume: 57b3037d-3c6d-4a20-9426-102a92aca261, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5183a0e0-2d0e-47aa-a3a0-0848d7d1d6fe]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:38 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f Apr 15 10:13:38 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:39 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f" returned: 0 in 0.525s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:39 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:39 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:13:39 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:13:39 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d36c12-4253-45df-aa64-cf14ef48c669]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:39 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 Apr 15 10:13:39 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:39 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" returned: 0 in 0.543s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:39 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:13:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:39 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 Apr 15 10:13:39 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:42 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261" returned: 0 in 2.284s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:42 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d12567-f1c9-425e-a09f-5a14af49c7e9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:42 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 Apr 15 10:13:42 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:42 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" returned: 0 in 0.742s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:42 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:13:42 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Converted 1024.00 MB image at 447.92 MB/s Apr 15 10:13:42 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 is being set with open permissions: ugo+rw Apr 15 10:13:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:42 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 Apr 15 10:13:42 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:43 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261" returned: 0 in 0.460s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-57b3037d-3c6d-4a20-9426-102a92aca261" released by "_copy_volume_from_snapshot" :: held 4.614s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-4ffc1652-5712-4687-b902-96d7f00bbe8f" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-4ffc1652-5712-4687-b902-96d7f00bbe8f" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Deleting offline snapshot 4ffc1652-5712-4687-b902-96d7f00bbe8f of volume 61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] snapshot_file for this snap is: volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd356f8-8d16-467e-99d7-aa04d9131eb2]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:43 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f Apr 15 10:13:43 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Flow 'volume_create_manager' (66650379-b5ba-4b0b-afb1-22536a460e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b916d3-78c5-4968-968a-1dd1b6a810a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b916d3-78c5-4968-968a-1dd1b6a810a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1949017991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b22ea4d-46c4-4eb8-b3ad-52955cab525e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72f7a25fee884a2da7e945dd71aa289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:44Z,use_quota=True,user_id='48d23e300dc0429e85d8bd982055ebfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393b7f34-0d8f-4ee9-b853-62e3d3e9edb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393b7f34-0d8f-4ee9-b853-62e3d3e9edb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85af862d-2e66-40d9-a6c9-e690f74898f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85af862d-2e66-40d9-a6c9-e690f74898f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b22ea4d-46c4-4eb8-b3ad-52955cab525e', 'volume_name': 'volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1388c782-3ee6-4fd9-ab10-b3dff1125a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1388c782-3ee6-4fd9-ab10-b3dff1125a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6412ae2-3345-41bf-af20-54fc34a326d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:44 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Volume 9b22ea4d-46c4-4eb8-b3ad-52955cab525e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e', 'volume_size': 1} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:44 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f" returned: 0 in 0.611s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c476223-7b0e-4e82-bc26-d0f550b11785]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:44 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 Apr 15 10:13:44 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:44 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" returned: 0 in 0.510s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:44 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f Apr 15 10:13:44 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:45 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f" returned: 0 in 0.547s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:45 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f Apr 15 10:13:45 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:45 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4.4ffc1652-5712-4687-b902-96d7f00bbe8f" returned: 0 in 0.464s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-4ffc1652-5712-4687-b902-96d7f00bbe8f" released by "_delete_snapshot" :: held 2.200s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.988s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.418s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Creating offline snapshot 81b8a065-4913-43a7-ab92-8ab2c89050b6 of volume 12ab5c98-12d1-436a-9a09-dc67fbcc8668 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd152bb-3165-41c7-b5d4-5f41bfc5d0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b3037d-3c6d-4a20-9426-102a92aca261', 'volume_size': 1, 'source_volid': '61a0c546-d2bb-4fce-937d-c7dedfcc67e4', 'source_volstatus': 'available'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5fb90b-df80-4343-be9a-6c0d1a58dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d932f754-b418-47f7-acbe-abbab8f7de10]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:45 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Volume volume-57b3037d-3c6d-4a20-9426-102a92aca261 (57b3037d-3c6d-4a20-9426-102a92aca261): created successfully Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5fb90b-df80-4343-be9a-6c0d1a58dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Flow 'volume_create_manager' (49cf0226-ce81-4d89-83bf-9f3b6d5c5d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8ed7eec9-c8b9-4957-a7d2-6015156fe359 tempest-VolumeDependencyTests-1344590227 None] Created volume successfully. Apr 15 10:13:45 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 Apr 15 10:13:45 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:46 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668" returned: 0 in 0.488s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:46 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 1G Apr 15 10:13:46 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:46 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 1G" returned: 0 in 0.497s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:46 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 Apr 15 10:13:46 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-61a0c546-d2bb-4fce-937d-c7dedfcc67e4-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-61a0c546-d2bb-4fce-937d-c7dedfcc67e4-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bb22a6-96e2-4d96-b343-8982cfabdbfb]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:46 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 Apr 15 10:13:46 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:47 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6" returned: 0 in 0.511s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:47 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 is being set with open permissions: ugo+rw Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:47 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 Apr 15 10:13:47 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:47 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" returned: 0 in 0.504s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:47 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4 Apr 15 10:13:47 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:47 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6" returned: 0 in 0.462s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:47 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.info Apr 15 10:13:47 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:47 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" returned: 0 in 0.484s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-61a0c546-d2bb-4fce-937d-c7dedfcc67e4" released by "delete_volume" :: held 1.023s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Created reservations ['d64842c2-4564-4dcd-a8ca-a1078b70fc3e', '378937bc-8caa-4122-a4a7-7c1bc4f0eee1', 'b4976249-5c53-4b25-b276-5a7a633669d2', '949aebd2-f825-41b9-a514-edc933968831'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:47 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:13:47 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:48 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.info" returned: 0 in 0.499s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:48 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.info is being set with open permissions: ugo+rw Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:48 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.info Apr 15 10:13:48 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:48 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.474s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:48 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Deleted volume successfully. Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-47bc48b3-9c22-4e32-a0a4-20baa0df24ea tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-61a0c546-d2bb-4fce-937d-c7dedfcc67e4-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:48 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.info" returned: 0 in 0.451s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.979s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.609s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1949017991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b22ea4d-46c4-4eb8-b3ad-52955cab525e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72f7a25fee884a2da7e945dd71aa289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:44Z,use_quota=True,user_id='48d23e300dc0429e85d8bd982055ebfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Creating volume 9b22ea4d-46c4-4eb8-b3ad-52955cab525e {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:48 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:48 devstack sudo[89309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e 1073741824 Apr 15 10:13:48 devstack sudo[89309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:48 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0164f39f-c831-40ab-b7bd-0822b2cc22e1 tempest-VolumesSnapshotTestJSON-355705279 None] Create snapshot completed successfully Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-57b3037d-3c6d-4a20-9426-102a92aca261-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-57b3037d-3c6d-4a20-9426-102a92aca261-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-57b3037d-3c6d-4a20-9426-102a92aca261" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-57b3037d-3c6d-4a20-9426-102a92aca261" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f4b35b-a335-46ea-9316-65c220a984d3]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-81b8a065-4913-43a7-ab92-8ab2c89050b6-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-81b8a065-4913-43a7-ab92-8ab2c89050b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-12ab5c98-12d1-436a-9a09-dc67fbcc8668" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:49 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 Apr 15 10:13:49 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-12ab5c98-12d1-436a-9a09-dc67fbcc8668" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-81b8a065-4913-43a7-ab92-8ab2c89050b6" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-81b8a065-4913-43a7-ab92-8ab2c89050b6" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Deleting offline snapshot 81b8a065-4913-43a7-ab92-8ab2c89050b6 of volume 12ab5c98-12d1-436a-9a09-dc67fbcc8668 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] snapshot_file for this snap is: volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d63e21d-429c-4089-a181-be02f4ad0a57]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:49 devstack sudo[89309]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e 1073741824" returned: 0 in 0.562s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:49 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 Apr 15 10:13:49 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:49 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e Apr 15 10:13:49 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:49 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261" returned: 0 in 0.551s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:49 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261 Apr 15 10:13:49 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:49 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6" returned: 0 in 0.506s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[354ff7f9-59b2-41ad-93db-8917af60fc5b]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:49 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e" returned: 0 in 0.435s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6412ae2-3345-41bf-af20-54fc34a326d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22678ad-e218-4098-8477-5485f8a8a4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:49 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Volume volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e (9b22ea4d-46c4-4eb8-b3ad-52955cab525e): created successfully Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c22678ad-e218-4098-8477-5485f8a8a4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Flow 'volume_create_manager' (66650379-b5ba-4b0b-afb1-22536a460e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:49 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4955d59f-4e83-4010-8959-b5a7af7c5843 tempest-VolumesListTestJSON-540105171 None] Created volume successfully. Apr 15 10:13:49 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 Apr 15 10:13:49 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:50 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-57b3037d-3c6d-4a20-9426-102a92aca261" returned: 0 in 0.463s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-57b3037d-3c6d-4a20-9426-102a92aca261" released by "delete_volume" :: held 1.047s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Created reservations ['c31f6100-dcf6-4261-8ab2-1a6a8767df8c', '6eb7dee3-fdae-46bf-b5b7-bc067dc1b1c6', '68d57b3c-b178-4de8-8e42-06b2c92c9109', '2ff442eb-effb-4f65-a309-db37407ec421'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:50 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:13:50 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:50 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668" returned: 0 in 0.531s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:50 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 Apr 15 10:13:50 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Flow 'volume_create_manager' (c85c34bb-7476-4b93-8472-c1de266b7902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d86a3a-1c86-47d3-858a-5d7d87d99713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9d86a3a-1c86-47d3-858a-5d7d87d99713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-174688263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cfe15d-a3eb-496b-98a5-af82b16cd82a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72f7a25fee884a2da7e945dd71aa289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:51Z,use_quota=True,user_id='48d23e300dc0429e85d8bd982055ebfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2721a7b0-c24e-419e-971d-fad602dec123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2721a7b0-c24e-419e-971d-fad602dec123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63381e96-181b-4e34-85b5-52b8b5a8fcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63381e96-181b-4e34-85b5-52b8b5a8fcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9cfe15d-a3eb-496b-98a5-af82b16cd82a', 'volume_name': 'volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb975fa-3a28-4144-8226-affd31971980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb975fa-3a28-4144-8226-affd31971980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b4e0f2-2f45-4e1e-a940-7d1d6e5fa6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:50 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Volume f9cfe15d-a3eb-496b-98a5-af82b16cd82a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a', 'volume_size': 1} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-174688263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cfe15d-a3eb-496b-98a5-af82b16cd82a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72f7a25fee884a2da7e945dd71aa289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:51Z,use_quota=True,user_id='48d23e300dc0429e85d8bd982055ebfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Creating volume f9cfe15d-a3eb-496b-98a5-af82b16cd82a {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:50 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.522s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:50 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Deleted volume successfully. Apr 15 10:13:50 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a 1073741824 Apr 15 10:13:50 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-68c402fa-e6a3-4fd9-a4c0-4c81a670492e tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-57b3037d-3c6d-4a20-9426-102a92aca261-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:50 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6" returned: 0 in 0.559s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:50 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6 Apr 15 10:13:50 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-ef3bc2a7-f188-4f87-87f4-abef1251ac8e-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-ef3bc2a7-f188-4f87-87f4-abef1251ac8e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:51 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a 1073741824" returned: 0 in 0.610s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "cinder-quobyte-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:51 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668.81b8a065-4913-43a7-ab92-8ab2c89050b6" returned: 0 in 0.521s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" acquired by "delete_volume" :: waited 0.032s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[58abb443-82df-41c4-95f8-df373587211d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-81b8a065-4913-43a7-ab92-8ab2c89050b6" released by "_delete_snapshot" :: held 2.209s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-12ab5c98-12d1-436a-9a09-dc67fbcc8668" released by "delete_snapshot" :: held 2.235s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:51 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a Apr 15 10:13:51 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:51 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e Apr 15 10:13:51 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Created reservations ['b07f012c-2066-4cbf-9e62-e51f979d479c', '4ee7166d-2671-42b6-b2ef-f07407c522c3', '9ce09b20-96f8-45b8-91a2-201348fd1b36', 'e07da049-7472-4cc2-b7dc-64b95802a6b4'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Delete snapshot completed successfully. Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f521a845-fd88-4d8c-8ad3-65a0fac64327 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-81b8a065-4913-43a7-ab92-8ab2c89050b6-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:51 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a" returned: 0 in 0.436s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8b4e0f2-2f45-4e1e-a940-7d1d6e5fa6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94745b73-fd50-429e-af30-82ac7618eb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:51 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Volume volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a (f9cfe15d-a3eb-496b-98a5-af82b16cd82a): created successfully Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94745b73-fd50-429e-af30-82ac7618eb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Flow 'volume_create_manager' (c85c34bb-7476-4b93-8472-c1de266b7902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-bc864d99-bfb3-45c3-aed8-a8776479bc44 tempest-VolumesListTestJSON-540105171 None] Created volume successfully. Apr 15 10:13:51 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" returned: 0 in 0.619s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:51 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e Apr 15 10:13:51 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:52 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" returned: 0 in 0.510s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-quobyte-ef3bc2a7-f188-4f87-87f4-abef1251ac8e" released by "delete_volume" :: held 1.157s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Created reservations ['f1b6d448-152f-45b5-8b0f-6196cdb99753', '9c6fa52e-cbe3-4d0e-9e1c-6cbc03dd5214', '8312441f-8bf8-4d40-b852-f366946d48c5', '267ab5b3-c6a9-4682-be86-df1805b6e37c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:52 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:13:52 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (0e46a81f-c9ae-47d0-b676-ba1d177e9665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289c7770-4db0-4f18-a7cd-64f5f1f34f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (289c7770-4db0-4f18-a7cd-64f5f1f34f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-602521963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0a369c-c5e8-4fac-b148-a1fed31451e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500ee3210a204e27989ecff66a868fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:53Z,use_quota=True,user_id='1aa18c1b53444010a644a06d66ec4ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b121ab-fc56-48c1-ad36-9f59d2a8dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3b121ab-fc56-48c1-ad36-9f59d2a8dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b303f2f-e9e8-4f81-b851-3f3a2a7bdced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b303f2f-e9e8-4f81-b851-3f3a2a7bdced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa0a369c-c5e8-4fac-b148-a1fed31451e7', 'volume_name': 'volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b340d86-4230-45d4-a908-d6d18fa7230a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b340d86-4230-45d4-a908-d6d18fa7230a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e02e571-8ac9-49c3-8c79-3d920d4cb720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:52 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Volume fa0a369c-c5e8-4fac-b148-a1fed31451e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7', 'volume_size': 1} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-602521963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa0a369c-c5e8-4fac-b148-a1fed31451e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500ee3210a204e27989ecff66a868fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:53Z,use_quota=True,user_id='1aa18c1b53444010a644a06d66ec4ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Creating volume fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:52 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:13:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:52 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 1073741824 Apr 15 10:13:52 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Flow 'volume_create_manager' (c33b7c99-7f16-4db4-b764-3c0926483fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57beefbc-865f-4d38-842e-ac399c91c848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:53 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57beefbc-865f-4d38-842e-ac399c91c848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1220375027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba680bf2-f454-4dd7-b6c9-a084b2b4d006,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72f7a25fee884a2da7e945dd71aa289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:53Z,use_quota=True,user_id='48d23e300dc0429e85d8bd982055ebfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77157196-165f-40aa-8491-a77e5f294450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77157196-165f-40aa-8491-a77e5f294450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3531626-21d4-4fdc-9f3c-48b217e77d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3531626-21d4-4fdc-9f3c-48b217e77d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba680bf2-f454-4dd7-b6c9-a084b2b4d006', 'volume_name': 'volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8145999-9222-47e2-9509-893e7f6c1edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8145999-9222-47e2-9509-893e7f6c1edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df77016e-3528-4d0b-94f6-a72086fe6109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:53 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Volume ba680bf2-f454-4dd7-b6c9-a084b2b4d006: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006', 'volume_size': 1} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.573s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:53 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Deleted volume successfully. Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-f5702997-0b43-4f22-a33f-dda1a63f6921 tempest-VolumeDependencyTests-1344590227 None] Lock "cinder-ef3bc2a7-f188-4f87-87f4-abef1251ac8e-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:53 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 1073741824" returned: 0 in 0.548s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:53 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 Apr 15 10:13:53 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:53 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7" returned: 0 in 0.454s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1220375027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba680bf2-f454-4dd7-b6c9-a084b2b4d006,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='72f7a25fee884a2da7e945dd71aa289b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:53Z,use_quota=True,user_id='48d23e300dc0429e85d8bd982055ebfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Creating volume ba680bf2-f454-4dd7-b6c9-a084b2b4d006 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:53 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e02e571-8ac9-49c3-8c79-3d920d4cb720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241dd538-8196-4394-bad9-526011f35409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:53 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 1073741824 Apr 15 10:13:53 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:53 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Volume volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 (fa0a369c-c5e8-4fac-b148-a1fed31451e7): created successfully Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (241dd538-8196-4394-bad9-526011f35409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (0e46a81f-c9ae-47d0-b676-ba1d177e9665) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:53 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c446a1f7-5761-448d-900d-e0634668ccb4 tempest-VolumesSnapshotTestJSON-355705279 None] Created volume successfully. Apr 15 10:13:54 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 1073741824" returned: 0 in 0.624s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:54 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 Apr 15 10:13:54 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:54 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006" returned: 0 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.196s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.056s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Creating offline snapshot c70b70da-bca7-474d-9b19-900bded69174 of volume fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df77016e-3528-4d0b-94f6-a72086fe6109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2755bc42-73f7-480a-b1b0-03d72077f47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[517e12f2-b159-40e3-bfa0-e577b3726ee6]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:54 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Volume volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 (ba680bf2-f454-4dd7-b6c9-a084b2b4d006): created successfully Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2755bc42-73f7-480a-b1b0-03d72077f47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Flow 'volume_create_manager' (c33b7c99-7f16-4db4-b764-3c0926483fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:54 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-fd4120dd-a920-4f1b-a94c-5eb632b939a3 tempest-VolumesListTestJSON-540105171 None] Created volume successfully. Apr 15 10:13:54 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 Apr 15 10:13:54 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:55 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:55 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 1G Apr 15 10:13:55 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:56 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 1G" returned: 0 in 0.610s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:56 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 Apr 15 10:13:56 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:56 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174" returned: 0 in 0.477s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:56 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 is being set with open permissions: ugo+rw Apr 15 10:13:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:56 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 Apr 15 10:13:56 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:56 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174" returned: 0 in 0.462s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:57 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.info Apr 15 10:13:57 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:57 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.info" returned: 0 in 0.451s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:57 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.info is being set with open permissions: ugo+rw Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Acquiring lock "cinder-ba680bf2-f454-4dd7-b6c9-a084b2b4d006-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:57 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.info Apr 15 10:13:57 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Lock "cinder-ba680bf2-f454-4dd7-b6c9-a084b2b4d006-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Acquiring lock "cinder-quobyte-ba680bf2-f454-4dd7-b6c9-a084b2b4d006" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Lock "cinder-quobyte-ba680bf2-f454-4dd7-b6c9-a084b2b4d006" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bfabbe-e291-4339-b3d7-1dfa9887a56f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:57 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 Apr 15 10:13:57 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:57 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.info" returned: 0 in 0.466s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.076s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c5a10a65-5a68-4ce3-9731-bea181538a78 tempest-VolumesSnapshotTestJSON-355705279 None] Create snapshot completed successfully Apr 15 10:13:58 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006" returned: 0 in 0.511s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:58 devstack sudo[89418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006 Apr 15 10:13:58 devstack sudo[89418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:58 devstack sudo[89418]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ba680bf2-f454-4dd7-b6c9-a084b2b4d006" returned: 0 in 0.481s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Lock "cinder-quobyte-ba680bf2-f454-4dd7-b6c9-a084b2b4d006" released by "delete_volume" :: held 1.014s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Created reservations ['ba0d61ec-a16c-472e-853d-748b47599756', '9ba2ce91-bc6a-4575-8172-db5ba117f9ac', 'b8b5cb9e-5d5c-4d80-a752-794ab3b502eb', '3bc4b2fc-ce42-4b6a-9884-39e2c02458c3'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:58 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:13:58 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:59 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.447s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:13:59 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Deleted volume successfully. Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4707dd5a-90b6-466c-85e8-e6deae7a831d tempest-VolumesListTestJSON-540105171 None] Lock "cinder-ba680bf2-f454-4dd7-b6c9-a084b2b4d006-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (3e700d24-6764-4c88-a9a8-d20f040d6700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251a0538-7846-47f3-b80b-dc93f80b6d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (251a0538-7846-47f3-b80b-dc93f80b6d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-795815079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6594c40c-1909-4060-92d3-2b63fd139bd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500ee3210a204e27989ecff66a868fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:13:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c70b70da-bca7-474d-9b19-900bded69174,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:13:59Z,use_quota=True,user_id='1aa18c1b53444010a644a06d66ec4ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91288f99-10bc-4242-bac5-6d8de234fe0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91288f99-10bc-4242-bac5-6d8de234fe0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80895139-f146-4951-81f7-025bbf46ef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80895139-f146-4951-81f7-025bbf46ef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6594c40c-1909-4060-92d3-2b63fd139bd9', 'volume_name': 'volume-6594c40c-1909-4060-92d3-2b63fd139bd9', 'volume_size': 2, 'snapshot_id': 'c70b70da-bca7-474d-9b19-900bded69174'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1130b357-c22e-4ddc-ab18-ef3288e21a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1130b357-c22e-4ddc-ab18-ef3288e21a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0451edf8-0581-4210-9293-b74e89957a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:13:59 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Volume 6594c40c-1909-4060-92d3-2b63fd139bd9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6594c40c-1909-4060-92d3-2b63fd139bd9', 'volume_size': 2, 'snapshot_id': 'c70b70da-bca7-474d-9b19-900bded69174'} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-c70b70da-bca7-474d-9b19-900bded69174-6594c40c-1909-4060-92d3-2b63fd139bd9" by "_create_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-c70b70da-bca7-474d-9b19-900bded69174-6594c40c-1909-4060-92d3-2b63fd139bd9" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Creating volume 6594c40c-1909-4060-92d3-2b63fd139bd9 from snapshot c70b70da-bca7-474d-9b19-900bded69174 {{(pid=82600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-6594c40c-1909-4060-92d3-2b63fd139bd9" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-6594c40c-1909-4060-92d3-2b63fd139bd9" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] snapshot: c70b70da-bca7-474d-9b19-900bded69174, volume: 6594c40c-1909-4060-92d3-2b63fd139bd9, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46ae963-d47f-4cbe-b125-57bb4bd15dc1]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:59 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 Apr 15 10:13:59 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "cinder-f9cfe15d-a3eb-496b-98a5-af82b16cd82a-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Lock "cinder-f9cfe15d-a3eb-496b-98a5-af82b16cd82a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "cinder-quobyte-f9cfe15d-a3eb-496b-98a5-af82b16cd82a" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Lock "cinder-quobyte-f9cfe15d-a3eb-496b-98a5-af82b16cd82a" acquired by "delete_volume" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a9c967-8b90-4892-b587-c0df3d06e7ed]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:59 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a Apr 15 10:13:59 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:13:59 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[380bfac9-8c0d-4963-9a7a-0beba2553bf3]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:13:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:13:59 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 Apr 15 10:13:59 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:00 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a" returned: 0 in 0.525s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:00 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a Apr 15 10:14:00 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:00 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7" returned: 0 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:00 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 Apr 15 10:14:00 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:00 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9cfe15d-a3eb-496b-98a5-af82b16cd82a" returned: 0 in 0.461s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Lock "cinder-quobyte-f9cfe15d-a3eb-496b-98a5-af82b16cd82a" released by "delete_volume" :: held 1.021s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Created reservations ['d8446c93-3c79-474c-bc60-b52cb4ac4333', '15ed240a-3611-4a25-9118-1792e7b786b7', '0fd7fc28-3f44-47ba-b88f-be37ad21af45', 'fd9a55f2-2e81-4653-9f26-21cf08f7d8f0'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:00 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:00 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:01 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.111s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:01 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:01 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Deleted volume successfully. Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5789ffa-2a69-442e-a6d9-34a2b60bc6c4 tempest-VolumesListTestJSON-540105171 None] Lock "cinder-f9cfe15d-a3eb-496b-98a5-af82b16cd82a-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "cinder-9b22ea4d-46c4-4eb8-b3ad-52955cab525e-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Lock "cinder-9b22ea4d-46c4-4eb8-b3ad-52955cab525e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "cinder-quobyte-9b22ea4d-46c4-4eb8-b3ad-52955cab525e" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Lock "cinder-quobyte-9b22ea4d-46c4-4eb8-b3ad-52955cab525e" acquired by "delete_volume" :: waited 0.026s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[862fb959-88ad-46a2-a5e3-5a26dc0f6235]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:02 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e Apr 15 10:14:02 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:02 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9" returned: 0 in 2.368s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[29371a31-ee07-43ea-a067-412dfaa517e8]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:02 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 Apr 15 10:14:02 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e" returned: 0 in 0.679s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:03 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e Apr 15 10:14:03 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7" returned: 0 in 0.664s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7, size 1024.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:14:03 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Converted 1024.00 MB image at 432.20 MB/s Apr 15 10:14:03 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 is being set with open permissions: ugo+rw Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:03 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 Apr 15 10:14:03 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9b22ea4d-46c4-4eb8-b3ad-52955cab525e" returned: 0 in 0.488s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Lock "cinder-quobyte-9b22ea4d-46c4-4eb8-b3ad-52955cab525e" released by "delete_volume" :: held 1.215s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Created reservations ['01eaa3f7-a420-45fb-9741-b5da5dd0c8a9', '6827dfcb-f206-4d72-a6a0-1fb564cd1999', 'cd45c5e7-e853-48d5-a63f-80fcda1afd5b', '5e0dcff3-ac7a-4792-86f6-eb8ee82e79a9'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:03 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:03 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:03 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9" returned: 0 in 0.466s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-6594c40c-1909-4060-92d3-2b63fd139bd9" released by "_copy_volume_from_snapshot" :: held 4.624s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-c70b70da-bca7-474d-9b19-900bded69174-6594c40c-1909-4060-92d3-2b63fd139bd9" released by "_create_volume_from_snapshot" :: held 4.643s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.652s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0451edf8-0581-4210-9293-b74e89957a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6594c40c-1909-4060-92d3-2b63fd139bd9', 'volume_size': 2, 'snapshot_id': 'c70b70da-bca7-474d-9b19-900bded69174'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91959ac-bfc4-4c69-954a-9e6feb500ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:04 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Volume volume-6594c40c-1909-4060-92d3-2b63fd139bd9 (6594c40c-1909-4060-92d3-2b63fd139bd9): created successfully Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c91959ac-bfc4-4c69-954a-9e6feb500ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (3e700d24-6764-4c88-a9a8-d20f040d6700) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-5a56a68d-8132-4c5c-8a51-3eba3a89572f tempest-VolumesSnapshotTestJSON-355705279 None] Created volume successfully. Apr 15 10:14:04 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.449s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Deleted volume successfully. Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6e840d6a-28d1-4b78-90c1-bb066fd6ee74 tempest-VolumesListTestJSON-540105171 None] Lock "cinder-9b22ea4d-46c4-4eb8-b3ad-52955cab525e-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-6594c40c-1909-4060-92d3-2b63fd139bd9-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-6594c40c-1909-4060-92d3-2b63fd139bd9-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-6594c40c-1909-4060-92d3-2b63fd139bd9" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-6594c40c-1909-4060-92d3-2b63fd139bd9" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df62d91-a3c8-4cf7-8164-16b7bdefce0a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:04 devstack sudo[89512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 Apr 15 10:14:04 devstack sudo[89512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:05 devstack sudo[89512]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9" returned: 0 in 0.581s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:05 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9 Apr 15 10:14:05 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:05 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-6594c40c-1909-4060-92d3-2b63fd139bd9" returned: 0 in 0.479s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-6594c40c-1909-4060-92d3-2b63fd139bd9" released by "delete_volume" :: held 1.092s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Created reservations ['6c6b1f8b-1e72-4af4-9749-a7b82c55a81c', 'd1c2cb36-13aa-42ea-b2f1-2df4663e8eed', 'b4b007f5-6414-44aa-b453-229e7a482e6f', '41507dcb-962c-408d-9afc-a5cdc1e1b690'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:06 devstack sudo[89520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:06 devstack sudo[89520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:06 devstack sudo[89520]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Flow 'volume_create_manager' (6ecb8f31-0c22-4214-843e-1d7fd735a183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed6f6e2-90a3-4f27-a25e-e01e9d021db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.546s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fed6f6e2-90a3-4f27-a25e-e01e9d021db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-992383741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80274452-db4f-4993-951e-bd7bc8b12ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16f8a1ea6b14bcab4a3de0ba4d948c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:07Z,use_quota=True,user_id='5c5e147041a64466842704476ad10158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a60120-1872-47b9-be90-7feb38dfea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94a60120-1872-47b9-be90-7feb38dfea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212e3272-d9aa-4b9b-8f1f-0467118064eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212e3272-d9aa-4b9b-8f1f-0467118064eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80274452-db4f-4993-951e-bd7bc8b12ac1', 'volume_name': 'volume-80274452-db4f-4993-951e-bd7bc8b12ac1', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5f2bac-9d2e-4cb3-b6f8-22ab36e85ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf5f2bac-9d2e-4cb3-b6f8-22ab36e85ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a454b3-58c4-4094-9605-739ce84f9001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:06 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Volume 80274452-db4f-4993-951e-bd7bc8b12ac1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80274452-db4f-4993-951e-bd7bc8b12ac1', 'volume_size': 1} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-992383741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80274452-db4f-4993-951e-bd7bc8b12ac1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16f8a1ea6b14bcab4a3de0ba4d948c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:07Z,use_quota=True,user_id='5c5e147041a64466842704476ad10158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Creating volume 80274452-db4f-4993-951e-bd7bc8b12ac1 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:06 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:06 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Deleted volume successfully. Apr 15 10:14:06 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1 1073741824 Apr 15 10:14:06 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-174eef5d-a725-4743-ad50-c2141c9ec14f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-6594c40c-1909-4060-92d3-2b63fd139bd9-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-c70b70da-bca7-474d-9b19-900bded69174-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-c70b70da-bca7-474d-9b19-900bded69174-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-fa0a369c-c5e8-4fac-b148-a1fed31451e7" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-fa0a369c-c5e8-4fac-b148-a1fed31451e7" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-c70b70da-bca7-474d-9b19-900bded69174" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-c70b70da-bca7-474d-9b19-900bded69174" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Deleting offline snapshot c70b70da-bca7-474d-9b19-900bded69174 of volume fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] snapshot_file for this snap is: volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe2a448-074c-4300-851b-f55c9390e3c9]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:07 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 Apr 15 10:14:07 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:07 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1 1073741824" returned: 0 in 0.554s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:07 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1 Apr 15 10:14:07 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:07 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174" returned: 0 in 0.537s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:07 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1" returned: 0 in 0.451s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0179c148-3c25-42e4-9706-371daff0e888]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05a454b3-58c4-4094-9605-739ce84f9001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80274452-db4f-4993-951e-bd7bc8b12ac1', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b10d07-ff18-4166-9977-e146de842d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:07 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Volume volume-80274452-db4f-4993-951e-bd7bc8b12ac1 (80274452-db4f-4993-951e-bd7bc8b12ac1): created successfully Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b10d07-ff18-4166-9977-e146de842d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:07 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Flow 'volume_create_manager' (6ecb8f31-0c22-4214-843e-1d7fd735a183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:07 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-dd4a60fc-eefd-4b6b-ab35-d8ea32ed8da8 tempest-VolumesNegativeTest-505077582 None] Created volume successfully. Apr 15 10:14:07 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 Apr 15 10:14:07 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:08 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7" returned: 0 in 0.502s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:08 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 Apr 15 10:14:08 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:08 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174" returned: 0 in 0.472s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:08 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174 Apr 15 10:14:08 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:09 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7.c70b70da-bca7-474d-9b19-900bded69174" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-c70b70da-bca7-474d-9b19-900bded69174" released by "_delete_snapshot" :: held 2.118s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-fa0a369c-c5e8-4fac-b148-a1fed31451e7" released by "delete_snapshot" :: held 2.132s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:09 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Created reservations ['64b9d08c-cad5-48e5-8c80-b81c720ddd72', '86620511-ab32-48be-a1fc-46c9f8ad9b78', 'c4672c86-3116-4710-ad8c-0836050c2983', '8fae149e-4ce1-4dc6-bb11-e26fee7e5f6e'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:09 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Delete snapshot completed successfully. Apr 15 10:14:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-2f1bd20b-38e8-426b-a2d0-857632ea1f4a tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-c70b70da-bca7-474d-9b19-900bded69174-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:10 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:10 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-fa0a369c-c5e8-4fac-b148-a1fed31451e7-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-fa0a369c-c5e8-4fac-b148-a1fed31451e7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-fa0a369c-c5e8-4fac-b148-a1fed31451e7" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-fa0a369c-c5e8-4fac-b148-a1fed31451e7" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[36773416-bac3-4f11-b162-f9a5c11cbcdd]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:10 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 Apr 15 10:14:10 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:10 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.511s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:10 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7" returned: 0 in 0.527s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:10 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7 Apr 15 10:14:10 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:11 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-fa0a369c-c5e8-4fac-b148-a1fed31451e7" returned: 0 in 0.457s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-fa0a369c-c5e8-4fac-b148-a1fed31451e7" released by "delete_volume" :: held 1.031s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Created reservations ['c95d9ec1-c621-4e85-bb31-31ab27cadbe2', 'bb3e830e-b34e-4db9-99b2-824217ef0ab8', '5b96b2ca-71c9-4415-bf64-5be48bb759ea', '4df8a102-623b-42c6-8525-a2250f504f88'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:11 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:11 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:11 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.417s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:11 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Deleted volume successfully. Apr 15 10:14:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-5800c82e-9af3-4ee7-9b83-da7d58c0e059 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-fa0a369c-c5e8-4fac-b148-a1fed31451e7-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:DELETE=13,cinder:SELECT=88,cinder:INSERT=35,cinder:UPDATE=122 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (9ba9f5be-b41f-4cd1-bb64-ea2b09f330d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac680dc2-ad7b-446a-b450-8e409a6beb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac680dc2-ad7b-446a-b450-8e409a6beb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1473980134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99464519-f448-4d6d-9dd4-757d7b174a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500ee3210a204e27989ecff66a868fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:13Z,use_quota=True,user_id='1aa18c1b53444010a644a06d66ec4ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf26768-1627-4380-900f-495ee88078bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccf26768-1627-4380-900f-495ee88078bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bb585e-f9cd-4090-926b-d7082d65ff26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65bb585e-f9cd-4090-926b-d7082d65ff26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99464519-f448-4d6d-9dd4-757d7b174a6f', 'volume_name': 'volume-99464519-f448-4d6d-9dd4-757d7b174a6f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ec974b-8fd5-4979-8aef-53279959df45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ec974b-8fd5-4979-8aef-53279959df45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f937271-34a0-424a-8738-581c2f82e3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:12 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Volume 99464519-f448-4d6d-9dd4-757d7b174a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99464519-f448-4d6d-9dd4-757d7b174a6f', 'volume_size': 1} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1473980134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99464519-f448-4d6d-9dd4-757d7b174a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500ee3210a204e27989ecff66a868fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:13Z,use_quota=True,user_id='1aa18c1b53444010a644a06d66ec4ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Creating volume 99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:12 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:14:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:12 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f 1073741824 Apr 15 10:14:12 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:13 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f 1073741824" returned: 0 in 0.495s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:13 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f Apr 15 10:14:13 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:13 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f" returned: 0 in 0.476s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:13 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f937271-34a0-424a-8738-581c2f82e3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99464519-f448-4d6d-9dd4-757d7b174a6f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ce5064-bd82-4b97-9d8c-3538bc61d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:13 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Volume volume-99464519-f448-4d6d-9dd4-757d7b174a6f (99464519-f448-4d6d-9dd4-757d7b174a6f): created successfully Apr 15 10:14:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ce5064-bd82-4b97-9d8c-3538bc61d449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:13 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (9ba9f5be-b41f-4cd1-bb64-ea2b09f330d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-69f87d9f-5fef-473d-b69b-1ebd55c7a8d1 tempest-VolumesSnapshotTestJSON-355705279 None] Created volume successfully. Apr 15 10:14:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Creating offline snapshot 9bd507a4-44c5-4252-8f90-6e16a7e73f9c of volume 99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:15 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[34059ed3-6006-4e91-a92f-3507a91eb4a4]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:15 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f Apr 15 10:14:15 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:15 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f" returned: 0 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:15 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c 1G Apr 15 10:14:15 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:16 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c 1G" returned: 0 in 0.529s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99464519-f448-4d6d-9dd4-757d7b174a6f -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:16 devstack sudo[89602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99464519-f448-4d6d-9dd4-757d7b174a6f -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c Apr 15 10:14:16 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:16 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99464519-f448-4d6d-9dd4-757d7b174a6f -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c" returned: 0 in 0.473s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:16 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c is being set with open permissions: ugo+rw Apr 15 10:14:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:16 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c Apr 15 10:14:16 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:17 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c" returned: 0 in 0.442s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:17 devstack sudo[89610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.info Apr 15 10:14:17 devstack sudo[89610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:17 devstack sudo[89610]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.info" returned: 0 in 0.444s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:17 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.info is being set with open permissions: ugo+rw Apr 15 10:14:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:17 devstack sudo[89613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.info Apr 15 10:14:17 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:17 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.info" returned: 0 in 0.426s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.919s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:17 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-84872a70-4b31-4d49-b5cc-e9f49ca0e2ac tempest-VolumesSnapshotTestJSON-355705279 None] Create snapshot completed successfully Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (d93133b5-65de-42dc-9610-056f756b155a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1014008f-2880-4d4f-959b-d81e77c061ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1014008f-2880-4d4f-959b-d81e77c061ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-334279503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fb50970-b61d-40c5-95d5-af0bd4425697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='500ee3210a204e27989ecff66a868fb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9bd507a4-44c5-4252-8f90-6e16a7e73f9c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:18Z,use_quota=True,user_id='1aa18c1b53444010a644a06d66ec4ea0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb3aa3f-1c4d-4729-8c32-031e1a4456c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb3aa3f-1c4d-4729-8c32-031e1a4456c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06b1401-bcba-4531-828e-e7a54335d59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06b1401-bcba-4531-828e-e7a54335d59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9fb50970-b61d-40c5-95d5-af0bd4425697', 'volume_name': 'volume-9fb50970-b61d-40c5-95d5-af0bd4425697', 'volume_size': 1, 'snapshot_id': '9bd507a4-44c5-4252-8f90-6e16a7e73f9c'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ec74ee-868a-412d-af4d-712f3804a76d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ec74ee-868a-412d-af4d-712f3804a76d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b878c016-b8c5-44ae-8412-dd10602d23d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:18 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Volume 9fb50970-b61d-40c5-95d5-af0bd4425697: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9fb50970-b61d-40c5-95d5-af0bd4425697', 'volume_size': 1, 'snapshot_id': '9bd507a4-44c5-4252-8f90-6e16a7e73f9c'} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-9bd507a4-44c5-4252-8f90-6e16a7e73f9c-9fb50970-b61d-40c5-95d5-af0bd4425697" by "_create_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-9bd507a4-44c5-4252-8f90-6e16a7e73f9c-9fb50970-b61d-40c5-95d5-af0bd4425697" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Creating volume 9fb50970-b61d-40c5-95d5-af0bd4425697 from snapshot 9bd507a4-44c5-4252-8f90-6e16a7e73f9c {{(pid=82600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-9fb50970-b61d-40c5-95d5-af0bd4425697" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-9fb50970-b61d-40c5-95d5-af0bd4425697" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] snapshot: 9bd507a4-44c5-4252-8f90-6e16a7e73f9c, volume: 9fb50970-b61d-40c5-95d5-af0bd4425697, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0cbf1f-6986-448f-a2bb-08bdd3644660]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:18 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c Apr 15 10:14:18 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:19 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c" returned: 0 in 0.485s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99464519-f448-4d6d-9dd4-757d7b174a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:14:19 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:14:19 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[397414f9-2fa4-4dad-81f8-6a17f0fed619]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:19 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f Apr 15 10:14:19 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:19 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f" returned: 0 in 0.489s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:19 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:14:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:19 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 Apr 15 10:14:19 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:22 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697" returned: 0 in 2.781s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:22 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[792a20a9-23f0-4d7f-9ea2-16d6cbdb362a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:22 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f Apr 15 10:14:22 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:22 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f" returned: 0 in 0.600s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:22 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f, size 1024.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:14:22 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Converted 1024.00 MB image at 368.07 MB/s Apr 15 10:14:22 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 is being set with open permissions: ugo+rw Apr 15 10:14:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:22 devstack sudo[89675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 Apr 15 10:14:22 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:23 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697" returned: 0 in 0.485s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-9fb50970-b61d-40c5-95d5-af0bd4425697" released by "_copy_volume_from_snapshot" :: held 4.901s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:23 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-9bd507a4-44c5-4252-8f90-6e16a7e73f9c-9fb50970-b61d-40c5-95d5-af0bd4425697" released by "_create_volume_from_snapshot" :: held 4.918s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.926s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b878c016-b8c5-44ae-8412-dd10602d23d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb50970-b61d-40c5-95d5-af0bd4425697', 'volume_size': 1, 'snapshot_id': '9bd507a4-44c5-4252-8f90-6e16a7e73f9c'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ca6c17-4a70-433f-bb01-b43266979de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:23 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Volume volume-9fb50970-b61d-40c5-95d5-af0bd4425697 (9fb50970-b61d-40c5-95d5-af0bd4425697): created successfully Apr 15 10:14:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ca6c17-4a70-433f-bb01-b43266979de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Flow 'volume_create_manager' (d93133b5-65de-42dc-9610-056f756b155a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:23 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-67a987b6-50d9-4ecc-a9ac-e227d94f1fa2 tempest-VolumesSnapshotTestJSON-355705279 None] Created volume successfully. Apr 15 10:14:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-9fb50970-b61d-40c5-95d5-af0bd4425697-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-9fb50970-b61d-40c5-95d5-af0bd4425697-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-9fb50970-b61d-40c5-95d5-af0bd4425697" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-9fb50970-b61d-40c5-95d5-af0bd4425697" acquired by "delete_volume" :: waited 0.043s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:24 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3521ee60-4e9d-44a6-aa03-b0009c11425f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:24 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 Apr 15 10:14:24 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:24 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697" returned: 0 in 0.574s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:24 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697 Apr 15 10:14:24 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:25 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-9fb50970-b61d-40c5-95d5-af0bd4425697" returned: 0 in 0.455s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-9fb50970-b61d-40c5-95d5-af0bd4425697" released by "delete_volume" :: held 1.068s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:25 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Created reservations ['1212b52e-a63d-45fd-892b-76c86230ab25', '790bd64e-6f2d-4809-b480-d93b0526fc08', 'b1a13b9d-68c4-4780-9ede-41325c4ce4fd', 'ffa3daf4-cf40-4212-abfc-5b82d3993112'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:25 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:25 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:26 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.495s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:26 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Deleted volume successfully. Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d42ae3a1-7809-4598-a575-a6afeb1dbd6f tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-9fb50970-b61d-40c5-95d5-af0bd4425697-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-9bd507a4-44c5-4252-8f90-6e16a7e73f9c-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-9bd507a4-44c5-4252-8f90-6e16a7e73f9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-99464519-f448-4d6d-9dd4-757d7b174a6f" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-99464519-f448-4d6d-9dd4-757d7b174a6f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-9bd507a4-44c5-4252-8f90-6e16a7e73f9c" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-9bd507a4-44c5-4252-8f90-6e16a7e73f9c" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Deleting offline snapshot 9bd507a4-44c5-4252-8f90-6e16a7e73f9c of volume 99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] snapshot_file for this snap is: volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a069b386-3ab4-4737-a3fd-272cc1f0dc52]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:26 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c Apr 15 10:14:26 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:27 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c" returned: 0 in 0.526s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99464519-f448-4d6d-9dd4-757d7b174a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:14:27 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d80866-e5c6-45aa-92e7-7b97c84b2453]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:27 devstack sudo[89726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f Apr 15 10:14:27 devstack sudo[89726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:27 devstack sudo[89726]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f" returned: 0 in 0.520s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:27 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c Apr 15 10:14:27 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:28 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c" returned: 0 in 0.460s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:28 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c Apr 15 10:14:28 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:28 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f.9bd507a4-44c5-4252-8f90-6e16a7e73f9c" returned: 0 in 0.437s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:28 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:UPDATE=130,cinder:DELETE=11,cinder:SELECT=123,cinder:INSERT=27 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:14:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-9bd507a4-44c5-4252-8f90-6e16a7e73f9c" released by "_delete_snapshot" :: held 2.004s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-99464519-f448-4d6d-9dd4-757d7b174a6f" released by "delete_snapshot" :: held 2.023s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:28 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Created reservations ['f387bb0b-ffe1-4dc8-b8ef-330fdf3c3fdf', '7594cf1e-9196-4c1c-b18e-65dfeb57b722', '9afd7046-ab71-4d60-8bc8-2a3420954660', '85fea152-2d91-4b81-88f8-e5fe64ed941c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:28 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Delete snapshot completed successfully. Apr 15 10:14:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-7b514c4e-582d-491b-9c24-6b4bf868e9e2 tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-9bd507a4-44c5-4252-8f90-6e16a7e73f9c-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-99464519-f448-4d6d-9dd4-757d7b174a6f-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-99464519-f448-4d6d-9dd4-757d7b174a6f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-99464519-f448-4d6d-9dd4-757d7b174a6f" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:29 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-99464519-f448-4d6d-9dd4-757d7b174a6f" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:29 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c7d33d-68f8-4f83-9d1c-84f19fe1b9dd]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:29 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f Apr 15 10:14:29 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:30 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f" returned: 0 in 0.584s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:30 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f Apr 15 10:14:30 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:30 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-99464519-f448-4d6d-9dd4-757d7b174a6f" returned: 0 in 0.516s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-99464519-f448-4d6d-9dd4-757d7b174a6f" released by "delete_volume" :: held 1.134s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:30 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Created reservations ['97fc8f70-94e7-4b1b-aa19-e4341ec31b17', '2e1f8d29-b9ba-416f-84f9-8044df6f9b82', '61a1920c-4d91-4c12-8010-1aa8b3ed2f06', '9fdcbdf5-353a-400a-94bc-5af2d6d595d5'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:31 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:31 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:31 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.500s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:31 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:31 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Deleted volume successfully. Apr 15 10:14:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e94b21b1-c41f-4cbe-9e79-f115f16d3c8d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-99464519-f448-4d6d-9dd4-757d7b174a6f-delete_volume" released by "delete_volume" :: held 1.813s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-12ab5c98-12d1-436a-9a09-dc67fbcc8668-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-12ab5c98-12d1-436a-9a09-dc67fbcc8668-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "cinder-quobyte-12ab5c98-12d1-436a-9a09-dc67fbcc8668" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-12ab5c98-12d1-436a-9a09-dc67fbcc8668" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:32 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74b5e5b-4530-486a-b2ac-f35afd08b4c3]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:32 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 Apr 15 10:14:32 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:32 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668" returned: 0 in 0.581s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:32 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668 Apr 15 10:14:32 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:33 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-12ab5c98-12d1-436a-9a09-dc67fbcc8668" returned: 0 in 0.492s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-quobyte-12ab5c98-12d1-436a-9a09-dc67fbcc8668" released by "delete_volume" :: held 1.115s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Created reservations ['049f8110-bab2-4bec-9f2c-0b8db0637dc0', '89c2774d-f7d1-467b-874b-f40520c4338a', '6dea7e05-c300-4b39-b141-9bf752b037c4', '962e3487-2ee8-434b-b1cf-f13c13258278'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:33 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:33 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Acquiring lock "cinder-80274452-db4f-4993-951e-bd7bc8b12ac1-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Lock "cinder-80274452-db4f-4993-951e-bd7bc8b12ac1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:33 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.480s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:33 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Deleted volume successfully. Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Acquiring lock "cinder-quobyte-80274452-db4f-4993-951e-bd7bc8b12ac1" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Lock "cinder-quobyte-80274452-db4f-4993-951e-bd7bc8b12ac1" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b25c8f3a-67a7-4867-bd33-6b1ea8c3773d tempest-VolumesSnapshotTestJSON-355705279 None] Lock "cinder-12ab5c98-12d1-436a-9a09-dc67fbcc8668-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a054eeb-91be-4243-bbfe-d4e883fbfe16]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:33 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1 Apr 15 10:14:33 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:34 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1" returned: 0 in 0.519s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:34 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1 Apr 15 10:14:34 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:34 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-80274452-db4f-4993-951e-bd7bc8b12ac1" returned: 0 in 0.459s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Lock "cinder-quobyte-80274452-db4f-4993-951e-bd7bc8b12ac1" released by "delete_volume" :: held 1.006s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Created reservations ['04af7916-ec4a-4485-bb4c-adb58cf4a785', '19de55d1-846f-4d92-8943-a2f677938bc4', '4c980d0a-bc7c-48f4-ada4-fc2006c89e55', '1527c851-2bb1-42ab-8c90-53de4a010eda'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:34 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:34 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:35 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.458s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:35 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:35 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Deleted volume successfully. Apr 15 10:14:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d109108c-c6d2-42a1-a910-b8a5f4408b1c tempest-VolumesNegativeTest-505077582 None] Lock "cinder-80274452-db4f-4993-951e-bd7bc8b12ac1-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (7625be65-e9ac-428d-a6d2-01102513e476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65266eb-2b8c-47e0-b59a-0f4dd98981ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65266eb-2b8c-47e0-b59a-0f4dd98981ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1174052322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33f06b8-ed6c-45e3-b4ae-ca113da98b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:39Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8b164c-4b27-4786-baaa-e5129279512b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb8b164c-4b27-4786-baaa-e5129279512b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a485b84-fd76-432b-90f8-2b07bbeb40cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a485b84-fd76-432b-90f8-2b07bbeb40cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c33f06b8-ed6c-45e3-b4ae-ca113da98b30', 'volume_name': 'volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dade4e2a-501f-45a9-afc7-5f8ae1aa95b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dade4e2a-501f-45a9-afc7-5f8ae1aa95b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdc0d11-c37f-4119-8934-07bb6f1eb293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:38 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume c33f06b8-ed6c-45e3-b4ae-ca113da98b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30', 'volume_size': 1} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1174052322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c33f06b8-ed6c-45e3-b4ae-ca113da98b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:39Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Creating volume c33f06b8-ed6c-45e3-b4ae-ca113da98b30 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:38 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:14:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:38 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 1073741824 Apr 15 10:14:38 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:39 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 1073741824" returned: 0 in 0.480s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:39 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 Apr 15 10:14:39 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:39 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" returned: 0 in 0.498s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:39 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdc0d11-c37f-4119-8934-07bb6f1eb293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d739a7a9-7763-45a3-8afb-804ead01db3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:39 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 (c33f06b8-ed6c-45e3-b4ae-ca113da98b30): created successfully Apr 15 10:14:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d739a7a9-7763-45a3-8afb-804ead01db3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (7625be65-e9ac-428d-a6d2-01102513e476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:39 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e53737b9-08c6-4c00-951b-992b48e61a99 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created volume successfully. Apr 15 10:14:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Creating offline snapshot 5abeb160-2847-426b-86d6-8db5f6c6ed46 of volume c33f06b8-ed6c-45e3-b4ae-ca113da98b30 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:40 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d744f1f-4810-4cc6-88e6-ee8b8d4227c6]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:41 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 Apr 15 10:14:41 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:41 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" returned: 0 in 0.609s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:41 devstack sudo[89792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 1G Apr 15 10:14:41 devstack sudo[89792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:42 devstack sudo[89792]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 1G" returned: 0 in 0.599s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:42 devstack sudo[89798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 Apr 15 10:14:42 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:42 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46" returned: 0 in 0.644s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:42 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 is being set with open permissions: ugo+rw Apr 15 10:14:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:42 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 Apr 15 10:14:42 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:43 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46" returned: 0 in 0.587s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:43 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.info Apr 15 10:14:43 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:43 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.info" returned: 0 in 0.494s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:43 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.info is being set with open permissions: ugo+rw Apr 15 10:14:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:43 devstack sudo[89809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.info Apr 15 10:14:43 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:44 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.info" returned: 0 in 0.477s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.482s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:44 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d6ea79b5-2cec-47c5-b139-e40d0aa06cf0 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Create snapshot completed successfully Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (2ce7325c-49d0-4c5b-817e-ff024103b3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bc84aa-ac6e-4526-831f-6344edc8d786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5bc84aa-ac6e-4526-831f-6344edc8d786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-999178567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cda874-e130-43f0-953b-ec1b1795cf62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:45Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ca78cd-72a3-4300-8319-b615149685bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14ca78cd-72a3-4300-8319-b615149685bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5922042d-92ad-42f5-b2cc-690431886d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5922042d-92ad-42f5-b2cc-690431886d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48cda874-e130-43f0-953b-ec1b1795cf62', 'volume_name': 'volume-48cda874-e130-43f0-953b-ec1b1795cf62', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde4982e-7dd9-4962-84fb-1f05b261c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde4982e-7dd9-4962-84fb-1f05b261c903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddd642e-6dff-428a-8c94-fd40c8ea33ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume 48cda874-e130-43f0-953b-ec1b1795cf62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48cda874-e130-43f0-953b-ec1b1795cf62', 'volume_size': 1} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-999178567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48cda874-e130-43f0-953b-ec1b1795cf62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:45Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Creating volume 48cda874-e130-43f0-953b-ec1b1795cf62 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:45 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:45 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62 1073741824 Apr 15 10:14:45 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (9ce324b3-c315-4d19-b87c-628f4ed28eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7584553-8253-4b55-91cc-493674d6dc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7584553-8253-4b55-91cc-493674d6dc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-804054607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4031c7c1-ee59-4324-90cf-15ff8a3eb718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:46Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ea9154-0a93-4e57-9c59-bed4aaadd0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4ea9154-0a93-4e57-9c59-bed4aaadd0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f616875b-3486-4f6a-a9d4-3b1239417f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f616875b-3486-4f6a-a9d4-3b1239417f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4031c7c1-ee59-4324-90cf-15ff8a3eb718', 'volume_name': 'volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e09c74-fa2a-4e49-a5ca-2d97596543b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e09c74-fa2a-4e49-a5ca-2d97596543b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31763522-4c3a-4318-9a2b-8bdf73b4f18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume 4031c7c1-ee59-4324-90cf-15ff8a3eb718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718', 'volume_size': 1} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (a1c6e0a7-17fc-488f-98f9-130a7de4b6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd38844f-ab87-4f33-b2df-d258014a4b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd38844f-ab87-4f33-b2df-d258014a4b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-171342631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59704b2a-62eb-4b02-aa61-2154b112dc4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:46Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864a538f-682d-4ef4-8645-bb5728842d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864a538f-682d-4ef4-8645-bb5728842d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69b9b42-31d3-440e-9b74-6d3d272de3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a69b9b42-31d3-440e-9b74-6d3d272de3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59704b2a-62eb-4b02-aa61-2154b112dc4c', 'volume_name': 'volume-59704b2a-62eb-4b02-aa61-2154b112dc4c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725c9a3b-ba76-4ad8-92aa-7d2ba94064af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (725c9a3b-ba76-4ad8-92aa-7d2ba94064af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715dd314-f95d-4ad9-b701-ac9e3a1581dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:45 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume 59704b2a-62eb-4b02-aa61-2154b112dc4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59704b2a-62eb-4b02-aa61-2154b112dc4c', 'volume_size': 1} Apr 15 10:14:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (1b00d4e9-fe10-47ee-a79e-15501293c235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5ad7ed-46cf-4990-afb9-d9a1aa0d31f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5ad7ed-46cf-4990-afb9-d9a1aa0d31f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-686521714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4863ee4c-de38-43f3-91e4-cc21b46c908a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:46Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738eb796-aa8c-49f1-8275-f54c37ec2ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (738eb796-aa8c-49f1-8275-f54c37ec2ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4483b3d7-5ac4-4b5f-ac3b-e854d5ddef35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4483b3d7-5ac4-4b5f-ac3b-e854d5ddef35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4863ee4c-de38-43f3-91e4-cc21b46c908a', 'volume_name': 'volume-4863ee4c-de38-43f3-91e4-cc21b46c908a', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b3d74e-0c6e-4946-8a45-963a6822cc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b3d74e-0c6e-4946-8a45-963a6822cc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310371d2-64e8-4d31-9f60-fa583f8367b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume 4863ee4c-de38-43f3-91e4-cc21b46c908a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4863ee4c-de38-43f3-91e4-cc21b46c908a', 'volume_size': 1} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62 1073741824" returned: 0 in 0.823s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:46 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62 Apr 15 10:14:46 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (57a837f7-3ac5-4569-8081-f2cc0d73e401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a729bc-770f-46c2-b820-4bb7795d5dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40a729bc-770f-46c2-b820-4bb7795d5dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106598882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac4876d-be98-44c3-afd3-ff8c1688fb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:46Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128a47dc-f557-4727-afb7-2f9a49a2ecea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (128a47dc-f557-4727-afb7-2f9a49a2ecea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862ea372-71ef-40e5-ba07-8e807588f62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (862ea372-71ef-40e5-ba07-8e807588f62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac4876d-be98-44c3-afd3-ff8c1688fb40', 'volume_name': 'volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a69562-020a-46ea-ba50-c7224d068344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a69562-020a-46ea-ba50-c7224d068344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6d40ef-1979-4cbe-b240-80969faa1cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume 8ac4876d-be98-44c3-afd3-ff8c1688fb40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40', 'volume_size': 1} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:46 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62" returned: 0 in 0.492s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.073s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-804054607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4031c7c1-ee59-4324-90cf-15ff8a3eb718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:46Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Creating volume 4031c7c1-ee59-4324-90cf-15ff8a3eb718 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:46 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:46 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 1073741824 Apr 15 10:14:46 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ddd642e-6dff-428a-8c94-fd40c8ea33ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48cda874-e130-43f0-953b-ec1b1795cf62', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc7ae99-ae14-46d3-b366-8aa9eedbf50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:46 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume volume-48cda874-e130-43f0-953b-ec1b1795cf62 (48cda874-e130-43f0-953b-ec1b1795cf62): created successfully Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc7ae99-ae14-46d3-b366-8aa9eedbf50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (2ce7325c-49d0-4c5b-817e-ff024103b3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:46 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-dcd3dd71-2dc8-4cd5-8dd8-6c99098a463c tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created volume successfully. Apr 15 10:14:47 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 1073741824" returned: 0 in 0.553s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:47 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 Apr 15 10:14:47 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:47 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718" returned: 0 in 0.593s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.016s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-171342631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59704b2a-62eb-4b02-aa61-2154b112dc4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:46Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Creating volume 59704b2a-62eb-4b02-aa61-2154b112dc4c {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:47 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:14:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31763522-4c3a-4318-9a2b-8bdf73b4f18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:48 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c 1073741824 Apr 15 10:14:48 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc83e7c-200c-42a6-86da-76745f445f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:48 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 (4031c7c1-ee59-4324-90cf-15ff8a3eb718): created successfully Apr 15 10:14:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc83e7c-200c-42a6-86da-76745f445f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (9ce324b3-c315-4d19-b87c-628f4ed28eb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:48 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0d1af8ab-f244-4398-aac9-b4233f174fdd tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created volume successfully. Apr 15 10:14:48 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c 1073741824" returned: 0 in 0.658s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:48 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c Apr 15 10:14:48 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:49 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c" returned: 0 in 0.515s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.916s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-686521714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4863ee4c-de38-43f3-91e4-cc21b46c908a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:46Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Creating volume 4863ee4c-de38-43f3-91e4-cc21b46c908a {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:49 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715dd314-f95d-4ad9-b701-ac9e3a1581dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59704b2a-62eb-4b02-aa61-2154b112dc4c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:49 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a 1073741824 Apr 15 10:14:49 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eb6d84-0eff-4b34-90cb-d88c4208126a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:49 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume volume-59704b2a-62eb-4b02-aa61-2154b112dc4c (59704b2a-62eb-4b02-aa61-2154b112dc4c): created successfully Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30eb6d84-0eff-4b34-90cb-d88c4208126a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (a1c6e0a7-17fc-488f-98f9-130a7de4b6c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:49 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-59a616bb-126f-474a-b51f-ecef34670012 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created volume successfully. Apr 15 10:14:49 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a 1073741824" returned: 0 in 0.617s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:49 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a Apr 15 10:14:49 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:50 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a" returned: 0 in 0.513s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.821s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106598882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac4876d-be98-44c3-afd3-ff8c1688fb40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834ce54c3b9f4fc48c8bbc5bba99f228',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:46Z,use_quota=True,user_id='610da34529354063951aaeb07ae1250b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Creating volume 8ac4876d-be98-44c3-afd3-ff8c1688fb40 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:50 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (310371d2-64e8-4d31-9f60-fa583f8367b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4863ee4c-de38-43f3-91e4-cc21b46c908a', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a85084-c8db-4515-a549-cc011e423a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:50 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 1073741824 Apr 15 10:14:50 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:50 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume volume-4863ee4c-de38-43f3-91e4-cc21b46c908a (4863ee4c-de38-43f3-91e4-cc21b46c908a): created successfully Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97a85084-c8db-4515-a549-cc011e423a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (1b00d4e9-fe10-47ee-a79e-15501293c235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:50 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-92c77807-3d42-44d3-b18e-ad0455c3bda8 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created volume successfully. Apr 15 10:14:50 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 1073741824" returned: 0 in 0.648s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:51 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 Apr 15 10:14:51 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:51 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40" returned: 0 in 0.541s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6d40ef-1979-4cbe-b240-80969faa1cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401e3995-3c59-4ef1-8a37-fc3f6d56e09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:51 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Volume volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 (8ac4876d-be98-44c3-afd3-ff8c1688fb40): created successfully Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401e3995-3c59-4ef1-8a37-fc3f6d56e09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Flow 'volume_create_manager' (57a837f7-3ac5-4569-8081-f2cc0d73e401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:51 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6274159d-2da0-429c-b1ae-f65c93762adc tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created volume successfully. Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-8ac4876d-be98-44c3-afd3-ff8c1688fb40-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-8ac4876d-be98-44c3-afd3-ff8c1688fb40-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-quobyte-8ac4876d-be98-44c3-afd3-ff8c1688fb40" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:52 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-8ac4876d-be98-44c3-afd3-ff8c1688fb40" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:52 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c49c53-5716-4926-acbd-1233d1c16f48]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:52 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 Apr 15 10:14:52 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:52 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40" returned: 0 in 0.620s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:52 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40 Apr 15 10:14:52 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:53 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8ac4876d-be98-44c3-afd3-ff8c1688fb40" returned: 0 in 0.559s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-8ac4876d-be98-44c3-afd3-ff8c1688fb40" released by "delete_volume" :: held 1.207s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created reservations ['06cc34df-5952-40ef-ae78-bf954a828614', 'b0ae7383-25fd-468e-b652-99563abb84c1', '90010194-bf5b-476e-ad0a-191eb84102ce', '462aa17f-ed72-4b06-aeef-5097e4ea5637'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:53 devstack sudo[89867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:53 devstack sudo[89867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Flow 'volume_create_manager' (91ee50db-77dd-4e4d-8d73-25e95b84d758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12170e60-8ea5-4163-9426-8ef38fad1d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12170e60-8ea5-4163-9426-8ef38fad1d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-139239302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ce82b6-be93-4d96-bbcc-b59c06d2b20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5a6c8aa5044a6d84b4f68d0bc89427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:54Z,use_quota=True,user_id='99a022fbcd9645468c85556ccc72c167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14a916a-ae44-4b1f-84ed-3a06e1a164c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14a916a-ae44-4b1f-84ed-3a06e1a164c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471906da-4469-417b-849d-c1dcb25d559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (471906da-4469-417b-849d-c1dcb25d559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58ce82b6-be93-4d96-bbcc-b59c06d2b20c', 'volume_name': 'volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358fec9a-01ba-4bfa-9291-c6d1c9c2ec04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358fec9a-01ba-4bfa-9291-c6d1c9c2ec04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc04455-add9-4b1c-bb43-c3c48b4768d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:53 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Volume 58ce82b6-be93-4d96-bbcc-b59c06d2b20c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c', 'volume_size': 1} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-139239302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58ce82b6-be93-4d96-bbcc-b59c06d2b20c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5a6c8aa5044a6d84b4f68d0bc89427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:14:54Z,use_quota=True,user_id='99a022fbcd9645468c85556ccc72c167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Creating volume 58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:14:53 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:53 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c 1073741824 Apr 15 10:14:53 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:53 devstack sudo[89867]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.520s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:53 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Deleted volume successfully. Apr 15 10:14:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e4aebc76-6039-46fb-b6d7-1fce223f33b1 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-8ac4876d-be98-44c3-afd3-ff8c1688fb40-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-4863ee4c-de38-43f3-91e4-cc21b46c908a-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-4863ee4c-de38-43f3-91e4-cc21b46c908a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-quobyte-4863ee4c-de38-43f3-91e4-cc21b46c908a" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-4863ee4c-de38-43f3-91e4-cc21b46c908a" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[101380ac-be8f-4e7b-8712-09e45fd4a088]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:54 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c 1073741824" returned: 0 in 0.592s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:54 devstack sudo[89875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a Apr 15 10:14:54 devstack sudo[89875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:54 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c Apr 15 10:14:54 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:54 devstack sudo[89875]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a" returned: 0 in 0.557s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:54 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" returned: 0 in 0.502s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:54 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a Apr 15 10:14:54 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fc04455-add9-4b1c-bb43-c3c48b4768d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e76c92-bfef-4c5e-90e3-1358b690bb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:14:54 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Volume volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c (58ce82b6-be93-4d96-bbcc-b59c06d2b20c): created successfully Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e76c92-bfef-4c5e-90e3-1358b690bb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:14:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Flow 'volume_create_manager' (91ee50db-77dd-4e4d-8d73-25e95b84d758) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:14:54 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-170d511e-ca9c-4be2-b9e2-380c1e6d2783 tempest-SnapshotDependencyTests-1161823486 None] Created volume successfully. Apr 15 10:14:55 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4863ee4c-de38-43f3-91e4-cc21b46c908a" returned: 0 in 0.431s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-4863ee4c-de38-43f3-91e4-cc21b46c908a" released by "delete_volume" :: held 1.009s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created reservations ['97498307-700c-448d-8f62-d3210f08da68', '2afd2c1a-6c61-451a-8c26-fea4e8dd3d56', 'c843307b-e64d-4118-ad9d-f6a795304ef7', '461c5af0-6b3a-4dc2-9033-7afb57334afc'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:55 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:55 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:55 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.487s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:55 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Deleted volume successfully. Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8a5cecd-261e-40b5-b7cc-dca80c444836 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-4863ee4c-de38-43f3-91e4-cc21b46c908a-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Creating offline snapshot 068efc1d-1c67-4d13-ac59-2a1685fcf05b of volume 58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc838d8-42a0-4e3f-9a15-4467f22f6a75]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:56 devstack sudo[89889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c Apr 15 10:14:56 devstack sudo[89889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-59704b2a-62eb-4b02-aa61-2154b112dc4c-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-59704b2a-62eb-4b02-aa61-2154b112dc4c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-quobyte-59704b2a-62eb-4b02-aa61-2154b112dc4c" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:56 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-59704b2a-62eb-4b02-aa61-2154b112dc4c" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:56 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25e1367-1372-4e31-ba02-e78787161537]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:56 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c Apr 15 10:14:56 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:56 devstack sudo[89889]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" returned: 0 in 0.670s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:56 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b 1G Apr 15 10:14:56 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c" returned: 0 in 0.579s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c Apr 15 10:14:57 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b 1G" returned: 0 in 0.509s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b Apr 15 10:14:57 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-59704b2a-62eb-4b02-aa61-2154b112dc4c" returned: 0 in 0.442s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-59704b2a-62eb-4b02-aa61-2154b112dc4c" released by "delete_volume" :: held 1.050s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created reservations ['dc83f850-83cb-47e7-8024-6748c4d5234e', 'c9dc017a-ee32-403f-945a-db697c20bad8', '44c7db9a-0164-4f42-9c15-f40219439259', '0ef57aad-6c51-4467-a0f6-466dd85b4434'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:57 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:57 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b" returned: 0 in 0.476s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:57 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b is being set with open permissions: ugo+rw Apr 15 10:14:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:57 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b Apr 15 10:14:57 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:58 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.460s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:14:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Deleted volume successfully. Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a7734558-fd35-4a5b-a920-94771e5f4fa9 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-59704b2a-62eb-4b02-aa61-2154b112dc4c-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:58 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b" returned: 0 in 0.470s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:58 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.info Apr 15 10:14:58 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:58 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.info" returned: 0 in 0.469s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:58 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.info is being set with open permissions: ugo+rw Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-4031c7c1-ee59-4324-90cf-15ff8a3eb718-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-4031c7c1-ee59-4324-90cf-15ff8a3eb718-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:58 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.info Apr 15 10:14:58 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-quobyte-4031c7c1-ee59-4324-90cf-15ff8a3eb718" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-4031c7c1-ee59-4324-90cf-15ff8a3eb718" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67d7617-df4d-4c90-b18e-12f0f6b00592]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:14:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:58 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 Apr 15 10:14:58 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:59 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.info" returned: 0 in 0.491s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.142s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:59 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2caa08b2-7495-4e4d-981c-6003df176d79 tempest-SnapshotDependencyTests-1161823486 None] Create snapshot completed successfully Apr 15 10:14:59 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718" returned: 0 in 0.555s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:59 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718 Apr 15 10:14:59 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:14:59 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4031c7c1-ee59-4324-90cf-15ff8a3eb718" returned: 0 in 0.460s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-4031c7c1-ee59-4324-90cf-15ff8a3eb718" released by "delete_volume" :: held 1.051s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created reservations ['76263f0c-c6f1-4d5b-bd1b-4a3cecbfcca3', 'c36e2bc0-371e-4418-a55d-60c18b44a63f', '569acdea-a69e-4454-8144-d8c9ab342a5a', '5621e4f0-2dfd-4205-8a9f-06560848fc40'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:14:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:14:59 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:14:59 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:00 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.459s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Deleted volume successfully. Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e0cabaf0-796e-4737-82e1-96f3295e6383 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-4031c7c1-ee59-4324-90cf-15ff8a3eb718-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Flow 'volume_create_manager' (d6f82ae8-ae12-45c9-b826-9de77484be7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb73579-f839-42e8-9e52-6a79ab52a2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bb73579-f839-42e8-9e52-6a79ab52a2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7ef7cfa-7bfc-465c-920e-0c0b8d91f800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5a6c8aa5044a6d84b4f68d0bc89427',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=068efc1d-1c67-4d13-ac59-2a1685fcf05b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:00Z,use_quota=True,user_id='99a022fbcd9645468c85556ccc72c167',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a23dd69-1ec5-4c0e-ab55-32ed661351b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a23dd69-1ec5-4c0e-ab55-32ed661351b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb388367-e1cb-4859-9f8d-8a5c0e5d56bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb388367-e1cb-4859-9f8d-8a5c0e5d56bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b7ef7cfa-7bfc-465c-920e-0c0b8d91f800', 'volume_name': 'volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800', 'volume_size': 1, 'snapshot_id': '068efc1d-1c67-4d13-ac59-2a1685fcf05b'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b655922-c64f-43ce-9212-15c244591d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b655922-c64f-43ce-9212-15c244591d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67652101-b20a-49e2-8e99-a56893773bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:00 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Volume b7ef7cfa-7bfc-465c-920e-0c0b8d91f800: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800', 'volume_size': 1, 'snapshot_id': '068efc1d-1c67-4d13-ac59-2a1685fcf05b'} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "cinder-quobyte-068efc1d-1c67-4d13-ac59-2a1685fcf05b-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" by "_create_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-068efc1d-1c67-4d13-ac59-2a1685fcf05b-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Creating volume b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 from snapshot 068efc1d-1c67-4d13-ac59-2a1685fcf05b {{(pid=82600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "cinder-quobyte-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] snapshot: 068efc1d-1c67-4d13-ac59-2a1685fcf05b, volume: b7ef7cfa-7bfc-465c-920e-0c0b8d91f800, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e8b057-ffc4-4bd5-8119-142b0ade411a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:00 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b Apr 15 10:15:00 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-48cda874-e130-43f0-953b-ec1b1795cf62-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-48cda874-e130-43f0-953b-ec1b1795cf62-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-quobyte-48cda874-e130-43f0-953b-ec1b1795cf62" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-48cda874-e130-43f0-953b-ec1b1795cf62" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c1da93-6495-4c64-b65e-aa59b7b841f7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:00 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62 Apr 15 10:15:00 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:01 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b" returned: 0 in 0.597s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9968ac3c-2c9e-4476-b3b2-14ba16c07c94]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:01 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c Apr 15 10:15:01 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:01 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62" returned: 0 in 0.516s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:01 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62 Apr 15 10:15:01 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:01 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:01 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 Apr 15 10:15:01 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:01 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-48cda874-e130-43f0-953b-ec1b1795cf62" returned: 0 in 0.449s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-48cda874-e130-43f0-953b-ec1b1795cf62" released by "delete_volume" :: held 1.007s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created reservations ['f0a3cdca-af2c-44e4-a56e-2a2de9c84943', '1cba099d-ae61-4a6f-b4e5-1b10289ec1b7', '9d3c023a-1efd-4945-8bf8-79b81ff29a89', '3cc5e0cf-e6ae-421c-a342-927a960d90bb'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:01 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:01 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:03 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.081s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:03 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Deleted volume successfully. Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4aa0c4ed-708c-47d6-9323-d38ce6139bd7 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-48cda874-e130-43f0-953b-ec1b1795cf62-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-5abeb160-2847-426b-86d6-8db5f6c6ed46-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-5abeb160-2847-426b-86d6-8db5f6c6ed46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-quobyte-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-quobyte-5abeb160-2847-426b-86d6-8db5f6c6ed46" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-5abeb160-2847-426b-86d6-8db5f6c6ed46" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Deleting offline snapshot 5abeb160-2847-426b-86d6-8db5f6c6ed46 of volume c33f06b8-ed6c-45e3-b4ae-ca113da98b30 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] snapshot_file for this snap is: volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9cd670-7343-411a-a7f5-24c3e3bb612e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:03 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 Apr 15 10:15:03 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:04 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" returned: 0 in 2.465s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cde021-76e5-415e-bea5-d7bca12fd67f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:04 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c Apr 15 10:15:04 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:04 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46" returned: 0 in 1.065s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed737d1-0bfa-40e3-8b90-efb25c50efef]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:04 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 Apr 15 10:15:04 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:04 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" returned: 0 in 0.511s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:04 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" returned: 0 in 0.671s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c, size 1024.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:15:04 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Converted 1024.00 MB image at 415.18 MB/s Apr 15 10:15:04 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 is being set with open permissions: ugo+rw Apr 15 10:15:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:04 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 Apr 15 10:15:04 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:04 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 Apr 15 10:15:04 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:05 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" returned: 0 in 0.456s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" released by "_copy_volume_from_snapshot" :: held 4.780s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-068efc1d-1c67-4d13-ac59-2a1685fcf05b-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" released by "_create_volume_from_snapshot" :: held 4.798s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.808s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:05 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46" returned: 0 in 0.498s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:05 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46 Apr 15 10:15:05 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67652101-b20a-49e2-8e99-a56893773bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800', 'volume_size': 1, 'snapshot_id': '068efc1d-1c67-4d13-ac59-2a1685fcf05b'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87701e91-b13c-4b0c-9f35-2c588c57acec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:05 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Volume volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 (b7ef7cfa-7bfc-465c-920e-0c0b8d91f800): created successfully Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87701e91-b13c-4b0c-9f35-2c588c57acec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Flow 'volume_create_manager' (d6f82ae8-ae12-45c9-b826-9de77484be7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:05 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-26122281-fa83-44fd-8b80-6793cdaf9e7e tempest-SnapshotDependencyTests-1161823486 None] Created volume successfully. Apr 15 10:15:05 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30.5abeb160-2847-426b-86d6-8db5f6c6ed46" returned: 0 in 0.454s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-5abeb160-2847-426b-86d6-8db5f6c6ed46" released by "_delete_snapshot" :: held 2.671s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" released by "delete_snapshot" :: held 2.689s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created reservations ['8116c5b7-904f-4ed3-9aa8-7c868958d7c2', 'f6dfe105-fa5a-4ecd-9993-3bbc38b8a4ad', '61f02a13-506d-4cae-9e1f-dd185d57759b', 'c01b54ce-4386-4d95-a0ed-1318f876fd23'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:05 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Delete snapshot completed successfully. Apr 15 10:15:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d514b92e-1d21-4d86-a270-242da75441af tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-5abeb160-2847-426b-86d6-8db5f6c6ed46-delete_snapshot" released by "delete_snapshot" :: held 2.818s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "cinder-068efc1d-1c67-4d13-ac59-2a1685fcf05b-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-068efc1d-1c67-4d13-ac59-2a1685fcf05b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "cinder-quobyte-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "cinder-quobyte-068efc1d-1c67-4d13-ac59-2a1685fcf05b" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-068efc1d-1c67-4d13-ac59-2a1685fcf05b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Deleting offline snapshot 068efc1d-1c67-4d13-ac59-2a1685fcf05b of volume 58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] snapshot_file for this snap is: volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce01eb0-e35b-42e5-be75-d2f400dfa925]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:06 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b Apr 15 10:15:06 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-c33f06b8-ed6c-45e3-b4ae-ca113da98b30-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-c33f06b8-ed6c-45e3-b4ae-ca113da98b30-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "cinder-quobyte-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1d5abe-61ca-4295-b3b9-919f4bc4bf41]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:06 devstack sudo[90033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 Apr 15 10:15:06 devstack sudo[90033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:06 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b" returned: 0 in 0.596s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aea39a-c79e-4cda-8bab-f2cbf4bd6883]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:06 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c Apr 15 10:15:06 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:06 devstack sudo[90033]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" returned: 0 in 0.533s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:06 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30 Apr 15 10:15:06 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:07 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" returned: 0 in 0.561s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:07 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b Apr 15 10:15:07 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:07 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" returned: 0 in 0.476s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-quobyte-c33f06b8-ed6c-45e3-b4ae-ca113da98b30" released by "delete_volume" :: held 1.059s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Created reservations ['0c3a86db-edac-4849-ba53-61c5ddac0599', 'd9893f08-eb53-42cb-bc59-79dc582cfa1e', '6968a301-065f-44bd-b044-4f56efadfdd1', 'afb09170-7113-4ad6-a025-2ee6540787fe'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:07 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:07 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:07 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b" returned: 0 in 0.518s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:07 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b Apr 15 10:15:07 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:08 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.517s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:08 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:08 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Deleted volume successfully. Apr 15 10:15:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ccdde65-a968-49f9-b0d1-f3416427d345 tempest-CreateVolumesFromSnapshotTest-1205878836 None] Lock "cinder-c33f06b8-ed6c-45e3-b4ae-ca113da98b30-delete_volume" released by "delete_volume" :: held 1.733s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:08 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c.068efc1d-1c67-4d13-ac59-2a1685fcf05b" returned: 0 in 0.465s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-068efc1d-1c67-4d13-ac59-2a1685fcf05b" released by "_delete_snapshot" :: held 2.196s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" released by "delete_snapshot" :: held 2.207s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:08 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Created reservations ['bb6c84fa-9388-40f5-8ffc-ee5d829b92bc', '2a365c68-34ee-40bb-922e-bcf8a076cf23', 'bd09d956-c9e8-4f9d-a0ba-a15ec548b5d1', '23a9158f-4df4-46f5-acb8-660c2fb43c52'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:08 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Delete snapshot completed successfully. Apr 15 10:15:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6a3824ab-6324-4dc2-b3ea-1ed35537d2a5 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-068efc1d-1c67-4d13-ac59-2a1685fcf05b-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "cinder-58ce82b6-be93-4d96-bbcc-b59c06d2b20c-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-58ce82b6-be93-4d96-bbcc-b59c06d2b20c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "cinder-quobyte-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:09 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e6f96c-dc62-47c5-be67-dd0698db4c1d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:09 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c Apr 15 10:15:09 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:09 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" returned: 0 in 0.545s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:09 devstack sudo[90065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c Apr 15 10:15:09 devstack sudo[90065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:10 devstack sudo[90068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:10 devstack sudo[90068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:10 devstack sudo[90065]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" returned: 0 in 0.444s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-58ce82b6-be93-4d96-bbcc-b59c06d2b20c" released by "delete_volume" :: held 1.029s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Created reservations ['ecc96771-f3b5-4dd6-96ca-35b297ac0c11', '189e5002-c250-4ce4-a259-9c97be12e56f', 'f069b3e5-38a1-49da-87f8-7a1d233f6d0e', '25719678-bf6b-40af-8c68-4fdc6c5047d9'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:10 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:10 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:10 devstack sudo[90068]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.477s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:10 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.423s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:10 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Deleted volume successfully. Apr 15 10:15:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-944b3b67-0f2a-46d8-a059-25a9f01162f4 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-58ce82b6-be93-4d96-bbcc-b59c06d2b20c-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "cinder-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "cinder-quobyte-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" acquired by "delete_volume" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[729bcee3-36fc-4cdf-8a32-cb35ba9ddd78]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:11 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 Apr 15 10:15:11 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:11 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" returned: 0 in 0.473s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:12 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800 Apr 15 10:15:12 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:12 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" returned: 0 in 0.441s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-quobyte-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800" released by "delete_volume" :: held 0.942s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:12 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Created reservations ['994a996e-6dc9-4c37-a1c1-1f6cc7bcae13', 'a5b754cd-0a00-4406-9799-3e2abad5fcd4', '70daffca-bff8-4d8c-a260-9dd551fbeff8', '08f50dfc-f27a-4fe5-8ce7-f123144624ab'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:12 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:12 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:13 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.486s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:13 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Deleted volume successfully. Apr 15 10:15:13 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:UPDATE=155,cinder:INSERT=37,cinder:SELECT=101,cinder:DELETE=9 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:15:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-23489acb-905c-4c0b-85bf-d52bbdfb5852 tempest-SnapshotDependencyTests-1161823486 None] Lock "cinder-b7ef7cfa-7bfc-465c-920e-0c0b8d91f800-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:22 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=99,cinder:INSERT=34,cinder:UPDATE=121,cinder:DELETE=14 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (603a08ad-a7ff-4656-8923-391bcc011fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ac9058-7c0f-4e9c-a796-b5768aa4d212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ac9058-7c0f-4e9c-a796-b5768aa4d212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-467894091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a850d26d-6ae8-45b5-9855-6fd7677e07eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b8d8b3-1281-4350-8d4f-4da5476ed6c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b8d8b3-1281-4350-8d4f-4da5476ed6c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edda6c85-a12f-4530-9d0a-219cb54583d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edda6c85-a12f-4530-9d0a-219cb54583d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a850d26d-6ae8-45b5-9855-6fd7677e07eb', 'volume_name': 'volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6878383-f24a-440a-b225-7ad61586608c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6878383-f24a-440a-b225-7ad61586608c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de45be2c-fb69-4626-9a90-ba372b289c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume a850d26d-6ae8-45b5-9855-6fd7677e07eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb', 'volume_size': 1} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-467894091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a850d26d-6ae8-45b5-9855-6fd7677e07eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Creating volume a850d26d-6ae8-45b5-9855-6fd7677e07eb {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:25 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:25 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb 1073741824 Apr 15 10:15:25 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Flow 'volume_create_manager' (e3acf987-609a-4332-af30-ba68eb675613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd4a4e4-2785-46cc-b4b0-bed1cadce93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd4a4e4-2785-46cc-b4b0-bed1cadce93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-389943526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acaef84-8641-46d5-aec2-091826013be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b318dd5514f6bbc4713a5c32ae6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='d02432d3b7774ff682edbe8c7331c674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019d6662-f214-4def-b2fd-ceec3bcf33a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019d6662-f214-4def-b2fd-ceec3bcf33a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ef09b6-cc49-4ae6-be86-b3c5e6e20db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54ef09b6-cc49-4ae6-be86-b3c5e6e20db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5acaef84-8641-46d5-aec2-091826013be1', 'volume_name': 'volume-5acaef84-8641-46d5-aec2-091826013be1', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d91c41a-73f0-4cb9-a7b8-3dc78c8608a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d91c41a-73f0-4cb9-a7b8-3dc78c8608a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54098ee-6493-4510-8c41-33d364105f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Volume 5acaef84-8641-46d5-aec2-091826013be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5acaef84-8641-46d5-aec2-091826013be1', 'volume_size': 1} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (1163eae2-229b-4fdc-b8a9-090c412fc201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f62b7f-0f56-4bbc-8460-ca85a48e2438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20f62b7f-0f56-4bbc-8460-ca85a48e2438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-113822251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfa515a-7f03-4020-b87c-3b07e979a690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a242a703-9b2b-48f6-8ff0-3dc63d7fdee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a242a703-9b2b-48f6-8ff0-3dc63d7fdee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2046d8b3-ebb9-4dea-b972-7072ffe65a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2046d8b3-ebb9-4dea-b972-7072ffe65a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cfa515a-7f03-4020-b87c-3b07e979a690', 'volume_name': 'volume-2cfa515a-7f03-4020-b87c-3b07e979a690', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240ff0e6-4350-4773-8c19-00f1b0188c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240ff0e6-4350-4773-8c19-00f1b0188c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f948b09f-f9d6-4f70-b204-247890a82096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:25 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Volume 2cfa515a-7f03-4020-b87c-3b07e979a690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cfa515a-7f03-4020-b87c-3b07e979a690', 'volume_size': 1} Apr 15 10:15:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (d5aa976a-1333-4c97-b20c-e1bafb5ccdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf0677d-109f-4660-a8d3-74fd7b603178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bf0677d-109f-4660-a8d3-74fd7b603178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1076936048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37ef866-27bb-456a-829a-f76d7edc7de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160d35d2-da9f-4208-b53e-70bcf2f33ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160d35d2-da9f-4208-b53e-70bcf2f33ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d128ba69-c4e0-47d5-8880-457675da5dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d128ba69-c4e0-47d5-8880-457675da5dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd37ef866-27bb-456a-829a-f76d7edc7de2', 'volume_name': 'volume-d37ef866-27bb-456a-829a-f76d7edc7de2', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13911c48-7b5a-4cb9-9157-7e29872651b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13911c48-7b5a-4cb9-9157-7e29872651b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac331aa-d763-43db-8d5b-ab5bbc73c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Volume d37ef866-27bb-456a-829a-f76d7edc7de2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d37ef866-27bb-456a-829a-f76d7edc7de2', 'volume_size': 1} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:26 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb 1073741824" returned: 0 in 0.719s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (297ccb35-daae-4ec7-ae5d-9192db3b91c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d54467-8c89-4ad6-b87c-3253086546e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04d54467-8c89-4ad6-b87c-3253086546e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1751430818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd8c937-d690-420b-9fbb-4fd2817b54e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f91558a-3ed0-45a1-84ea-16af4b4a56c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f91558a-3ed0-45a1-84ea-16af4b4a56c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bf2358-3e65-479e-be4b-03e639361eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89bf2358-3e65-479e-be4b-03e639361eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fd8c937-d690-420b-9fbb-4fd2817b54e8', 'volume_name': 'volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f704bc7-a252-45f6-b58e-8c43eaba3633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f704bc7-a252-45f6-b58e-8c43eaba3633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71eaba49-51fd-48ed-8229-08047483d869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Volume 8fd8c937-d690-420b-9fbb-4fd2817b54e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8', 'volume_size': 1} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:26 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb Apr 15 10:15:26 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (88fd1ddc-3db5-4b17-a1fd-eb0b01ad107a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a28dcf3-298a-40ce-9216-6dfad65b2c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a28dcf3-298a-40ce-9216-6dfad65b2c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1357802811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8c5287-204a-4817-8b4d-f04d86b1dc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:27Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a33558-b9a9-482f-9a89-34bcbc886516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35a33558-b9a9-482f-9a89-34bcbc886516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cfa93e-f481-4616-8429-88b8859ed4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cfa93e-f481-4616-8429-88b8859ed4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c8c5287-204a-4817-8b4d-f04d86b1dc7c', 'volume_name': 'volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a00edd-28ec-4605-98d9-a12d6a90731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74a00edd-28ec-4605-98d9-a12d6a90731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6274ece-7d2e-4e29-80e3-1d603212ddc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:26 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Volume 0c8c5287-204a-4817-8b4d-f04d86b1dc7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c', 'volume_size': 1} Apr 15 10:15:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (e91aec8d-201d-4095-8402-2d658f44e7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea81aee3-6d1f-4b6a-b997-716ca799d124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea81aee3-6d1f-4b6a-b997-716ca799d124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105553318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77096b0-e00e-48f2-8b55-cf70b49a75db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:27Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6150b3bc-e35f-4312-8776-4465ef82a83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6150b3bc-e35f-4312-8776-4465ef82a83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f9f44-bab8-43e8-b6fa-ccb8d3c52b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f9f44-bab8-43e8-b6fa-ccb8d3c52b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e77096b0-e00e-48f2-8b55-cf70b49a75db', 'volume_name': 'volume-e77096b0-e00e-48f2-8b55-cf70b49a75db', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df89f10d-ab4d-4d19-8584-79da0c07be39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df89f10d-ab4d-4d19-8584-79da0c07be39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755c6df2-fa94-41e4-a0f6-5e081e4e851e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:27 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Volume e77096b0-e00e-48f2-8b55-cf70b49a75db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e77096b0-e00e-48f2-8b55-cf70b49a75db', 'volume_size': 1} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb" returned: 0 in 0.544s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.241s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-389943526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acaef84-8641-46d5-aec2-091826013be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b318dd5514f6bbc4713a5c32ae6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='d02432d3b7774ff682edbe8c7331c674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Creating volume 5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:27 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de45be2c-fb69-4626-9a90-ba372b289c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60844a4-537e-4e76-ac91-13a7b48389fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:27 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 1073741824 Apr 15 10:15:27 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:27 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb (a850d26d-6ae8-45b5-9855-6fd7677e07eb): created successfully Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c60844a4-537e-4e76-ac91-13a7b48389fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (603a08ad-a7ff-4656-8923-391bcc011fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:27 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-91da1140-83d9-4273-bb70-e2385ac40033 tempest-CreateVolumesFromSnapshotTest-810032428 None] Created volume successfully. Apr 15 10:15:27 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 1073741824" returned: 0 in 0.587s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:27 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 Apr 15 10:15:27 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:28 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1" returned: 0 in 0.556s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.267s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-113822251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cfa515a-7f03-4020-b87c-3b07e979a690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Creating volume 2cfa515a-7f03-4020-b87c-3b07e979a690 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:28 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d54098ee-6493-4510-8c41-33d364105f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5acaef84-8641-46d5-aec2-091826013be1', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3507c5-9990-42ad-8b50-abdf6e2ba09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:28 devstack sudo[90147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690 1073741824 Apr 15 10:15:28 devstack sudo[90147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:28 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Volume volume-5acaef84-8641-46d5-aec2-091826013be1 (5acaef84-8641-46d5-aec2-091826013be1): created successfully Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3507c5-9990-42ad-8b50-abdf6e2ba09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Flow 'volume_create_manager' (e3acf987-609a-4332-af30-ba68eb675613) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:28 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c91518f2-e4fa-4a5b-a2f7-2cbba40b4f2a tempest-VolumeDependencyTests-1201689548 None] Created volume successfully. Apr 15 10:15:28 devstack sudo[90147]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690 1073741824" returned: 0 in 0.604s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:28 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690 Apr 15 10:15:28 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:29 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690" returned: 0 in 0.581s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.241s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1076936048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37ef866-27bb-456a-829a-f76d7edc7de2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Creating volume d37ef866-27bb-456a-829a-f76d7edc7de2 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:29 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f948b09f-f9d6-4f70-b204-247890a82096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cfa515a-7f03-4020-b87c-3b07e979a690', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2797bf-b954-42a2-b9ce-9a894da3d8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:29 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2 1073741824 Apr 15 10:15:29 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Volume volume-2cfa515a-7f03-4020-b87c-3b07e979a690 (2cfa515a-7f03-4020-b87c-3b07e979a690): created successfully Apr 15 10:15:29 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef2797bf-b954-42a2-b9ce-9a894da3d8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:29 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (1163eae2-229b-4fdc-b8a9-090c412fc201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:29 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ef0fb50b-9228-453a-88a9-cbb532909597 tempest-CreateVolumesFromImageTest-1804121286 None] Created volume successfully. Apr 15 10:15:30 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2 1073741824" returned: 0 in 0.627s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:30 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2 Apr 15 10:15:30 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:30 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2" returned: 0 in 0.504s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.151s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1751430818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd8c937-d690-420b-9fbb-4fd2817b54e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:26Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Creating volume 8fd8c937-d690-420b-9fbb-4fd2817b54e8 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:30 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac331aa-d763-43db-8d5b-ab5bbc73c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d37ef866-27bb-456a-829a-f76d7edc7de2', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacd1997-da05-421e-b8ce-2261c31c05a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:30 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 1073741824 Apr 15 10:15:30 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:30 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Volume volume-d37ef866-27bb-456a-829a-f76d7edc7de2 (d37ef866-27bb-456a-829a-f76d7edc7de2): created successfully Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cacd1997-da05-421e-b8ce-2261c31c05a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:30 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (d5aa976a-1333-4c97-b20c-e1bafb5ccdb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8483f0f6-005d-421e-a966-fa8ebe6f5199 tempest-CreateVolumesFromImageTest-1804121286 None] Created volume successfully. Apr 15 10:15:31 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 1073741824" returned: 0 in 0.649s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:31 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 Apr 15 10:15:31 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:31 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8" returned: 0 in 0.558s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.128s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1357802811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c8c5287-204a-4817-8b4d-f04d86b1dc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:27Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Creating volume 0c8c5287-204a-4817-8b4d-f04d86b1dc7c {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:31 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:31 devstack sudo[90176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c 1073741824 Apr 15 10:15:31 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71eaba49-51fd-48ed-8229-08047483d869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:31 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5343518-2e42-4d02-bfc8-88f84039bd96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:32 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Volume volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 (8fd8c937-d690-420b-9fbb-4fd2817b54e8): created successfully Apr 15 10:15:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5343518-2e42-4d02-bfc8-88f84039bd96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:32 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (297ccb35-daae-4ec7-ae5d-9192db3b91c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:32 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1e6376bb-63fa-4842-8dc6-b2b75f896308 tempest-CreateVolumesFromImageTest-1804121286 None] Created volume successfully. Apr 15 10:15:32 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c 1073741824" returned: 0 in 0.562s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:32 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c Apr 15 10:15:32 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:33 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c" returned: 0 in 0.510s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.971s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2105553318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e77096b0-e00e-48f2-8b55-cf70b49a75db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50899000f0ff4ad683d2d15b7bea1bfe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:27Z,use_quota=True,user_id='f0898e3425a14e8da8803cf50fe0217a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Creating volume e77096b0-e00e-48f2-8b55-cf70b49a75db {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:33 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6274ece-7d2e-4e29-80e3-1d603212ddc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:33 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db 1073741824 Apr 15 10:15:33 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40937ea4-5683-4548-932f-eaca92932269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:33 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Volume volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c (0c8c5287-204a-4817-8b4d-f04d86b1dc7c): created successfully Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40937ea4-5683-4548-932f-eaca92932269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (88fd1ddc-3db5-4b17-a1fd-eb0b01ad107a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:33 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2b161271-0635-4ab9-8ebd-00616d5bcc0f tempest-CreateVolumesFromImageTest-1804121286 None] Created volume successfully. Apr 15 10:15:33 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db 1073741824" returned: 0 in 0.600s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:33 devstack sudo[90189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db Apr 15 10:15:33 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:34 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db" returned: 0 in 0.464s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.149s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755c6df2-fa94-41e4-a0f6-5e081e4e851e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e77096b0-e00e-48f2-8b55-cf70b49a75db', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a04c0ad-c00f-44fe-9de0-dd1ba3761cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Creating offline snapshot 97375a34-5868-45fb-bdb6-319d8a26e861 of volume a850d26d-6ae8-45b5-9855-6fd7677e07eb {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05f20c5-653d-4bef-a3fc-22c581d6bb65]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:34 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Volume volume-e77096b0-e00e-48f2-8b55-cf70b49a75db (e77096b0-e00e-48f2-8b55-cf70b49a75db): created successfully Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a04c0ad-c00f-44fe-9de0-dd1ba3761cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Flow 'volume_create_manager' (e91aec8d-201d-4095-8402-2d658f44e7c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:34 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-1e6d43d1-ce13-47bf-b9c8-3470eb59ad29 tempest-CreateVolumesFromImageTest-1804121286 None] Created volume successfully. Apr 15 10:15:34 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb Apr 15 10:15:34 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-e77096b0-e00e-48f2-8b55-cf70b49a75db-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-e77096b0-e00e-48f2-8b55-cf70b49a75db-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-quobyte-e77096b0-e00e-48f2-8b55-cf70b49a75db" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-e77096b0-e00e-48f2-8b55-cf70b49a75db" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[97491787-848c-4b15-9451-1a5e79e8c414]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:34 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db Apr 15 10:15:34 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:34 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb" returned: 0 in 0.657s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:34 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 1G Apr 15 10:15:34 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:35 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db" returned: 0 in 0.650s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:35 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db Apr 15 10:15:35 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:35 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 1G" returned: 0 in 0.600s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:35 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 Apr 15 10:15:35 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:35 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e77096b0-e00e-48f2-8b55-cf70b49a75db" returned: 0 in 0.531s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-e77096b0-e00e-48f2-8b55-cf70b49a75db" released by "delete_volume" :: held 1.216s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:35 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Created reservations ['d25918cd-e428-4b14-97b8-c7640755d468', '06a5438e-2e18-4d37-962a-2e1437e65774', 'cf07e21d-6b01-4199-896e-dbebd086647b', '424e6431-5a56-41f7-b7ab-1443aef7154b'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:36 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861" returned: 0 in 0.559s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 is being set with open permissions: ugo+rw Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:36 devstack sudo[90216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 Apr 15 10:15:36 devstack sudo[90216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:36 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:36 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:36 devstack sudo[90216]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861" returned: 0 in 0.494s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.485s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:36 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Deleted volume successfully. Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cfab67ae-771f-40dd-a732-6a74245c9819 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-e77096b0-e00e-48f2-8b55-cf70b49a75db-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:36 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.info Apr 15 10:15:36 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-0c8c5287-204a-4817-8b4d-f04d86b1dc7c-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-0c8c5287-204a-4817-8b4d-f04d86b1dc7c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-quobyte-0c8c5287-204a-4817-8b4d-f04d86b1dc7c" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-0c8c5287-204a-4817-8b4d-f04d86b1dc7c" acquired by "delete_volume" :: waited 0.007s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7077d019-f64a-409c-8e83-cc4f780ee09d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:36 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack sudo[90224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c Apr 15 10:15:37 devstack sudo[90224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:37 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.info" returned: 0 in 0.527s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:37 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.info is being set with open permissions: ugo+rw Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack sudo[90227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.info Apr 15 10:15:37 devstack sudo[90227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:37 devstack sudo[90224]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c" returned: 0 in 0.584s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c Apr 15 10:15:37 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:37 devstack sudo[90227]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.info" returned: 0 in 0.501s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.430s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.452s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Creating offline snapshot 2068bec8-6dba-493f-8366-4dcb8ab1e735 of volume 5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b72e0ac-e4a4-47c8-b2f1-064a055bae93]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:37 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:37 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cd81ce32-72f2-409e-bf37-8d620593d279 tempest-CreateVolumesFromSnapshotTest-810032428 None] Create snapshot completed successfully Apr 15 10:15:37 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 Apr 15 10:15:37 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:38 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0c8c5287-204a-4817-8b4d-f04d86b1dc7c" returned: 0 in 0.513s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-0c8c5287-204a-4817-8b4d-f04d86b1dc7c" released by "delete_volume" :: held 1.123s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Created reservations ['10693298-1890-4101-9079-198e7e6ff39f', '5af0d6df-e075-46be-94a1-2ae5f9b58a40', '0a0a4b9d-91fd-48f1-a186-6b912bb4583a', '8b20c94a-92cd-457c-b6a0-76f7230b5afd'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:38 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:38 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:38 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1" returned: 0 in 0.587s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:38 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 1G Apr 15 10:15:38 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (18d721f3-8770-4453-a646-b11d5ace14fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023258cf-bac8-4724-b40d-c281902c292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (023258cf-bac8-4724-b40d-c281902c292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32968526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceabf892-1dcf-43c9-909a-1e88cd330216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:39Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9874a8-68f2-4d1e-8155-dd7681a20ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a9874a8-68f2-4d1e-8155-dd7681a20ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07f7b20-0500-4633-990a-b0dcaa1cf9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c07f7b20-0500-4633-990a-b0dcaa1cf9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceabf892-1dcf-43c9-909a-1e88cd330216', 'volume_name': 'volume-ceabf892-1dcf-43c9-909a-1e88cd330216', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8eb129-7d07-47ec-9077-4d2c7ee3a06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8eb129-7d07-47ec-9077-4d2c7ee3a06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fe4cff-27d1-4746-b5ab-65c168842f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:38 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume ceabf892-1dcf-43c9-909a-1e88cd330216: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceabf892-1dcf-43c9-909a-1e88cd330216', 'volume_size': 1} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:38 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 1G" returned: 0 in 0.698s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5acaef84-8641-46d5-aec2-091826013be1 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:38 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5acaef84-8641-46d5-aec2-091826013be1 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 Apr 15 10:15:38 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:38 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.831s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:38 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:38 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Deleted volume successfully. Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e1c733da-4caa-493f-a90b-7ddd56b57851 tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-0c8c5287-204a-4817-8b4d-f04d86b1dc7c-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (46070a24-5c1e-405f-abc9-e4dbc9ed7492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2369c7-b65f-4825-b3af-4aa5c1cf6185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-8fd8c937-d690-420b-9fbb-4fd2817b54e8-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f2369c7-b65f-4825-b3af-4aa5c1cf6185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773027648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02681eaf-966b-4a18-88b7-7275ddfd2b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:39Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae21e279-d038-4985-9c7f-adb4d334749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae21e279-d038-4985-9c7f-adb4d334749f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d5183c-6a21-4172-9ba6-5c7b5d148de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8d5183c-6a21-4172-9ba6-5c7b5d148de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02681eaf-966b-4a18-88b7-7275ddfd2b3f', 'volume_name': 'volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca36e5f5-b87a-4c94-b066-9225408c1ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca36e5f5-b87a-4c94-b066-9225408c1ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb24af2-587b-432b-8328-9bb74f4ef9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume 02681eaf-966b-4a18-88b7-7275ddfd2b3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f', 'volume_size': 1} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-8fd8c937-d690-420b-9fbb-4fd2817b54e8-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-quobyte-8fd8c937-d690-420b-9fbb-4fd2817b54e8" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-8fd8c937-d690-420b-9fbb-4fd2817b54e8" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a2fae-5d81-4465-82f1-bbb98625ac4b]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:39 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 Apr 15 10:15:39 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (ce9fc97e-726b-4aa5-a3f9-79437301ad08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41adde31-2a48-4cc7-8f79-7e0a2103769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41adde31-2a48-4cc7-8f79-7e0a2103769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1769162577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22bd686-4fa2-467d-897c-dc3aa70635af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:39Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae0e2a5-5273-45e2-a6bd-693ca50a87d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae0e2a5-5273-45e2-a6bd-693ca50a87d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb47525-3ab3-4f8b-a42d-89770e388e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fb47525-3ab3-4f8b-a42d-89770e388e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b22bd686-4fa2-467d-897c-dc3aa70635af', 'volume_name': 'volume-b22bd686-4fa2-467d-897c-dc3aa70635af', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a60c7e-c36a-40ed-a2c9-b376ca7357c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69a60c7e-c36a-40ed-a2c9-b376ca7357c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93c5299-1631-4e7f-b06e-1a31f5aded4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume b22bd686-4fa2-467d-897c-dc3aa70635af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b22bd686-4fa2-467d-897c-dc3aa70635af', 'volume_size': 1} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (c3ffb4aa-3f61-421b-b5b5-38593dda7dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:39 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c00407-d1ba-49be-a1d0-e23a8f96a934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5acaef84-8641-46d5-aec2-091826013be1 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735" returned: 0 in 0.908s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:39 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 is being set with open permissions: ugo+rw Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c00407-d1ba-49be-a1d0-e23a8f96a934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1575945798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779c1178-a16e-4654-bf26-0a32be656be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:40Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 Apr 15 10:15:39 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162d78ea-b53a-4c54-8870-fbeef195dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162d78ea-b53a-4c54-8870-fbeef195dd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17eebc7-0b77-4079-89d7-3e8a70973008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c17eebc7-0b77-4079-89d7-3e8a70973008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779c1178-a16e-4654-bf26-0a32be656be7', 'volume_name': 'volume-779c1178-a16e-4654-bf26-0a32be656be7', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3828e7f-8a2a-4536-b85b-ff6fc613a30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3828e7f-8a2a-4536-b85b-ff6fc613a30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:39 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa038b09-cf3f-4482-ae76-4ee2e592928e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:39 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume 779c1178-a16e-4654-bf26-0a32be656be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779c1178-a16e-4654-bf26-0a32be656be7', 'volume_size': 1} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8" returned: 0 in 0.679s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:39 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:40 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8 Apr 15 10:15:40 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (2fadf893-7044-4207-b9fb-86f0990fcb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992ece1b-c3cc-4e6f-bc4e-2513d009a241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992ece1b-c3cc-4e6f-bc4e-2513d009a241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370195110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d063f72-79b7-490c-ac0c-7fab00cf4a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:40Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dc6377-01b5-41f2-abf4-3783ba3beefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29dc6377-01b5-41f2-abf4-3783ba3beefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea479ac6-2021-417a-b25e-fc56464fa049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea479ac6-2021-417a-b25e-fc56464fa049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d063f72-79b7-490c-ac0c-7fab00cf4a97', 'volume_name': 'volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03755444-3cb3-448c-b092-497e3eea8bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03755444-3cb3-448c-b092-497e3eea8bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0187e3-7930-4c4d-b516-9632de9d0a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:40 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume 7d063f72-79b7-490c-ac0c-7fab00cf4a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97', 'volume_size': 1} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:40 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735" returned: 0 in 0.687s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:40 devstack sudo[90265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.info Apr 15 10:15:40 devstack sudo[90265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:40 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-8fd8c937-d690-420b-9fbb-4fd2817b54e8" returned: 0 in 0.636s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-8fd8c937-d690-420b-9fbb-4fd2817b54e8" released by "delete_volume" :: held 1.347s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Created reservations ['af62d518-6fe9-476a-ae70-7eacd37a11da', 'ea5ae841-b079-44b3-b648-fffad1ab9953', '4f0f56e4-011d-4c4a-b8c5-f692afa33f14', 'e71a43cf-ad9d-48bb-b0ac-7ac211215f45'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:40 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:40 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:40 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack sudo[90265]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.info" returned: 0 in 0.588s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:41 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.info is being set with open permissions: ugo+rw Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:41 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.info Apr 15 10:15:41 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.542s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:41 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Deleted volume successfully. Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ee914e18-887b-40bc-b951-6436e98894db tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-8fd8c937-d690-420b-9fbb-4fd2817b54e8-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-d37ef866-27bb-456a-829a-f76d7edc7de2-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-d37ef866-27bb-456a-829a-f76d7edc7de2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-quobyte-d37ef866-27bb-456a-829a-f76d7edc7de2" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-d37ef866-27bb-456a-829a-f76d7edc7de2" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2fa04a8-9abd-44bd-9fb9-6efbed216e65]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:41 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2 Apr 15 10:15:41 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.info" returned: 0 in 0.617s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.164s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.925s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-32968526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceabf892-1dcf-43c9-909a-1e88cd330216,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:39Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Creating volume ceabf892-1dcf-43c9-909a-1e88cd330216 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:41 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:41 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:41 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216 1073741824 Apr 15 10:15:41 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:41 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-20a1776a-3211-492a-b561-5430bfdf6dd3 tempest-VolumeDependencyTests-1201689548 None] Create snapshot completed successfully Apr 15 10:15:42 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2" returned: 0 in 0.556s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:42 devstack sudo[90282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2 Apr 15 10:15:42 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:42 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216 1073741824" returned: 0 in 0.697s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:42 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216 Apr 15 10:15:42 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:42 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-d37ef866-27bb-456a-829a-f76d7edc7de2" returned: 0 in 0.613s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-d37ef866-27bb-456a-829a-f76d7edc7de2" released by "delete_volume" :: held 1.203s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Created reservations ['15b01d83-0c90-4f28-a712-1557f23029a7', '103955b7-ffe5-48d0-9c36-b4fe1cc65433', '7276f952-e605-469e-9254-5e873eb05b82', '0a09290f-a9dc-46b2-9406-32c8217fd79a'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:42 devstack sudo[90290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:42 devstack sudo[90290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Flow 'volume_create_manager' (a146b3df-54d5-489f-9acc-0261545ca321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:42 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd24940b-252e-4d5e-ae4d-990afc73a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd24940b-252e-4d5e-ae4d-990afc73a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-752776742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9984e3a-3e53-4216-a07a-0636df4e31a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e47ea36f25240bc8594d8a2f92958fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:43Z,use_quota=True,user_id='0a7c535e974e45c49f40e27b989fa1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baaea22-81af-4bea-9a31-eac717d6b710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3baaea22-81af-4bea-9a31-eac717d6b710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0034d9-0c8d-4e9e-9ca9-229c684b4151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0034d9-0c8d-4e9e-9ca9-229c684b4151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9984e3a-3e53-4216-a07a-0636df4e31a8', 'volume_name': 'volume-f9984e3a-3e53-4216-a07a-0636df4e31a8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc39213-cbbe-400c-901c-01860b941385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cc39213-cbbe-400c-901c-01860b941385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b811857-4944-471a-acba-dd017b6e9594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Volume f9984e3a-3e53-4216-a07a-0636df4e31a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9984e3a-3e53-4216-a07a-0636df4e31a8', 'volume_size': 1} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:43 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Flow 'volume_create_manager' (2677ac8b-e5e7-440b-98d8-314193ad90fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936b1886-ad80-458e-884b-cca68658ea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216" returned: 0 in 0.643s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.925s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-773027648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02681eaf-966b-4a18-88b7-7275ddfd2b3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:39Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Creating volume 02681eaf-966b-4a18-88b7-7275ddfd2b3f {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:43 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37fe4cff-27d1-4746-b5ab-65c168842f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceabf892-1dcf-43c9-909a-1e88cd330216', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f 1073741824 Apr 15 10:15:43 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4128a2b0-95f6-4abb-8b1c-2e05c285d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (936b1886-ad80-458e-884b-cca68658ea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1432913784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc69b5a7-602a-4895-ab32-c9a2bdfcba9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b318dd5514f6bbc4713a5c32ae6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2068bec8-6dba-493f-8366-4dcb8ab1e735,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:43Z,use_quota=True,user_id='d02432d3b7774ff682edbe8c7331c674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139a03b4-726d-44dc-a1f8-ed12b9bfe31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (139a03b4-726d-44dc-a1f8-ed12b9bfe31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef49dc3-e4a2-45ae-8ccc-530dd9440323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ef49dc3-e4a2-45ae-8ccc-530dd9440323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bc69b5a7-602a-4895-ab32-c9a2bdfcba9e', 'volume_name': 'volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e', 'volume_size': 1, 'snapshot_id': '2068bec8-6dba-493f-8366-4dcb8ab1e735'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dced9d-9f74-46d7-b500-c3affcb282f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60dced9d-9f74-46d7-b500-c3affcb282f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a635dd-b268-46fb-882f-7171f8291d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:43 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Volume bc69b5a7-602a-4895-ab32-c9a2bdfcba9e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e', 'volume_size': 1, 'snapshot_id': '2068bec8-6dba-493f-8366-4dcb8ab1e735'} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:43 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume volume-ceabf892-1dcf-43c9-909a-1e88cd330216 (ceabf892-1dcf-43c9-909a-1e88cd330216): created successfully Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4128a2b0-95f6-4abb-8b1c-2e05c285d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (18d721f3-8770-4453-a646-b11d5ace14fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:43 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-531142ee-6009-4e2c-b5cd-3efd237e629c tempest-CreateVolumesFromSnapshotTest-810032428 None] Created volume successfully. Apr 15 10:15:43 devstack sudo[90290]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.667s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:43 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Deleted volume successfully. Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-c78dafe2-3fab-4c06-b3c3-bd2273bac06d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-d37ef866-27bb-456a-829a-f76d7edc7de2-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-2cfa515a-7f03-4020-b87c-3b07e979a690-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-2cfa515a-7f03-4020-b87c-3b07e979a690-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "cinder-quobyte-2cfa515a-7f03-4020-b87c-3b07e979a690" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-2cfa515a-7f03-4020-b87c-3b07e979a690" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[1def2de7-1c6a-45f4-9289-6570d2fa9117]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:43 devstack sudo[90299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690 Apr 15 10:15:43 devstack sudo[90299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:43 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f 1073741824" returned: 0 in 0.653s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:43 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:43 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f Apr 15 10:15:43 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack sudo[90299]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690" returned: 0 in 0.513s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack sudo[90307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690 Apr 15 10:15:44 devstack sudo[90307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f" returned: 0 in 0.453s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.739s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1769162577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b22bd686-4fa2-467d-897c-dc3aa70635af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:39Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Creating volume b22bd686-4fa2-467d-897c-dc3aa70635af {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:44 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb24af2-587b-432b-8328-9bb74f4ef9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:44 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af 1073741824 Apr 15 10:15:44 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c452d9-fa6f-4eea-be1d-2af6b5d791ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:44 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f (02681eaf-966b-4a18-88b7-7275ddfd2b3f): created successfully Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c452d9-fa6f-4eea-be1d-2af6b5d791ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (46070a24-5c1e-405f-abc9-e4dbc9ed7492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:44 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-bf364055-7592-4e81-8b98-a402a22ff470 tempest-CreateVolumesFromSnapshotTest-810032428 None] Created volume successfully. Apr 15 10:15:44 devstack sudo[90307]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-2cfa515a-7f03-4020-b87c-3b07e979a690" returned: 0 in 0.440s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-quobyte-2cfa515a-7f03-4020-b87c-3b07e979a690" released by "delete_volume" :: held 0.987s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Created reservations ['b8906905-75f4-45d3-baa7-8345d26de86c', '8902a2de-9ab0-4743-90ed-87f3f866775f', 'dc955154-1c27-4efb-8dd1-ff425c6543ac', '0168ad50-7763-4abc-88d6-5aecad11bc98'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:44 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:44 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af 1073741824" returned: 0 in 0.573s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:44 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:44 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af Apr 15 10:15:44 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:45 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.472s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Deleted volume successfully. Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-baaa434b-9b08-4d70-a0cf-3069cff29f5d tempest-CreateVolumesFromImageTest-1804121286 None] Lock "cinder-2cfa515a-7f03-4020-b87c-3b07e979a690-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:45 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af" returned: 0 in 0.487s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.432s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1575945798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779c1178-a16e-4654-bf26-0a32be656be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:40Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Creating volume 779c1178-a16e-4654-bf26-0a32be656be7 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:45 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93c5299-1631-4e7f-b06e-1a31f5aded4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b22bd686-4fa2-467d-897c-dc3aa70635af', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:45 devstack sudo[90321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7 1073741824 Apr 15 10:15:45 devstack sudo[90321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff8453c-5875-4bdd-9418-993c78c666d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:45 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume volume-b22bd686-4fa2-467d-897c-dc3aa70635af (b22bd686-4fa2-467d-897c-dc3aa70635af): created successfully Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff8453c-5875-4bdd-9418-993c78c666d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:45 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (ce9fc97e-726b-4aa5-a3f9-79437301ad08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:45 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-eba5bf78-8842-4c84-b087-5440bf7cf8fb tempest-CreateVolumesFromSnapshotTest-810032428 None] Created volume successfully. Apr 15 10:15:46 devstack sudo[90321]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7 1073741824" returned: 0 in 0.653s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:46 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7 Apr 15 10:15:46 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:46 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7" returned: 0 in 0.553s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.414s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1370195110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d063f72-79b7-490c-ac0c-7fab00cf4a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d23cf083c73411886501bed7b3cef9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:40Z,use_quota=True,user_id='b779e369eaf04515a44f17ac347093db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Creating volume 7d063f72-79b7-490c-ac0c-7fab00cf4a97 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:46 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:46 devstack sudo[90329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 1073741824 Apr 15 10:15:46 devstack sudo[90329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa038b09-cf3f-4482-ae76-4ee2e592928e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779c1178-a16e-4654-bf26-0a32be656be7', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a473ff47-ffc5-41ec-bb3c-482f2dd1116b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:46 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume volume-779c1178-a16e-4654-bf26-0a32be656be7 (779c1178-a16e-4654-bf26-0a32be656be7): created successfully Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a473ff47-ffc5-41ec-bb3c-482f2dd1116b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:46 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (c3ffb4aa-3f61-421b-b5b5-38593dda7dd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:46 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6b68c929-37df-46dc-8346-7472d698cae6 tempest-CreateVolumesFromSnapshotTest-810032428 None] Created volume successfully. Apr 15 10:15:47 devstack sudo[90329]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 1073741824" returned: 0 in 0.695s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:47 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:47 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 Apr 15 10:15:47 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:48 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97" returned: 0 in 0.606s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.983s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-752776742',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9984e3a-3e53-4216-a07a-0636df4e31a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e47ea36f25240bc8594d8a2f92958fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:43Z,use_quota=True,user_id='0a7c535e974e45c49f40e27b989fa1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Creating volume f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:48 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:48 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 1073741824 Apr 15 10:15:48 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0187e3-7930-4c4d-b516-9632de9d0a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fca9cd7-24c0-4bf8-8441-ffcb6faf5d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:48 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Volume volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 (7d063f72-79b7-490c-ac0c-7fab00cf4a97): created successfully Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fca9cd7-24c0-4bf8-8441-ffcb6faf5d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Flow 'volume_create_manager' (2fadf893-7044-4207-b9fb-86f0990fcb4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (6c68706c-0cbd-43ed-b095-dfcd869c8f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77739cf2-99df-4f5d-b094-b39f61b15735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:48 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-96e9f126-475e-4377-822b-81e6e1e30905 tempest-CreateVolumesFromSnapshotTest-810032428 None] Created volume successfully. Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77739cf2-99df-4f5d-b094-b39f61b15735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1163102844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495ee27d-69d1-4f88-a142-8a492ce8a008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:48Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e4fdcf-74f3-4a88-8545-f0541b46d8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e4fdcf-74f3-4a88-8545-f0541b46d8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95abf8a4-9dd2-4f8b-b2f2-583e60b79973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95abf8a4-9dd2-4f8b-b2f2-583e60b79973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495ee27d-69d1-4f88-a142-8a492ce8a008', 'volume_name': 'volume-495ee27d-69d1-4f88-a142-8a492ce8a008', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37207944-75b8-4d22-ae31-9bc37169ab79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37207944-75b8-4d22-ae31-9bc37169ab79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205bc2d3-9273-43cf-a26c-23afa87b01e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:48 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume 495ee27d-69d1-4f88-a142-8a492ce8a008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495ee27d-69d1-4f88-a142-8a492ce8a008', 'volume_size': 1} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:48 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 1073741824" returned: 0 in 0.663s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:48 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 Apr 15 10:15:48 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-7d063f72-79b7-490c-ac0c-7fab00cf4a97-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-7d063f72-79b7-490c-ac0c-7fab00cf4a97-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-quobyte-7d063f72-79b7-490c-ac0c-7fab00cf4a97" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-7d063f72-79b7-490c-ac0c-7fab00cf4a97" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4222c03-0524-42ee-8f4a-b66c3abc315c]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:48 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 Apr 15 10:15:49 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8" returned: 0 in 0.518s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.019s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-2068bec8-6dba-493f-8366-4dcb8ab1e735-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" by "_create_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b811857-4944-471a-acba-dd017b6e9594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9984e3a-3e53-4216-a07a-0636df4e31a8', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffff9b47-e405-4607-9669-57fe2bdbc795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-2068bec8-6dba-493f-8366-4dcb8ab1e735-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Creating volume bc69b5a7-602a-4895-ab32-c9a2bdfcba9e from snapshot 2068bec8-6dba-493f-8366-4dcb8ab1e735 {{(pid=82600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:49 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Volume volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 (f9984e3a-3e53-4216-a07a-0636df4e31a8): created successfully Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffff9b47-e405-4607-9669-57fe2bdbc795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Flow 'volume_create_manager' (a146b3df-54d5-489f-9acc-0261545ca321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] snapshot: 2068bec8-6dba-493f-8366-4dcb8ab1e735, volume: bc69b5a7-602a-4895-ab32-c9a2bdfcba9e, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:15:49 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-33974520-b77b-440b-aee3-26f6556e24f5 tempest-SnapshotDependencyTests-803932322 None] Created volume successfully. Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f57780a-7ba6-4ee0-8189-8613cef022c7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 Apr 15 10:15:49 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97" returned: 0 in 0.555s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[90352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97 Apr 15 10:15:49 devstack sudo[90352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735" returned: 0 in 0.488s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5acaef84-8641-46d5-aec2-091826013be1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[137abac5-9ab2-4943-84e9-46712ca8728d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:49 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 Apr 15 10:15:49 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:49 devstack sudo[90352]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7d063f72-79b7-490c-ac0c-7fab00cf4a97" returned: 0 in 0.460s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:49 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-7d063f72-79b7-490c-ac0c-7fab00cf4a97" released by "delete_volume" :: held 1.047s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Created reservations ['6c94c9f5-58c2-4ea5-ac9a-91e73374ca95', '6d0730c7-4346-4945-b658-a68d102ff0d2', '8edbad8a-6b81-4d9d-a853-e99814815647', '7e0fecfc-fa24-40b5-8d69-81668a9456d3'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:50 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:50 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:50 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1" returned: 0 in 0.502s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:50 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e Apr 15 10:15:50 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:50 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.506s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:50 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Deleted volume successfully. Apr 15 10:15:50 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6aa18bb8-c662-4d25-a935-b3bb52381dc9 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-7d063f72-79b7-490c-ac0c-7fab00cf4a97-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-779c1178-a16e-4654-bf26-0a32be656be7-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-779c1178-a16e-4654-bf26-0a32be656be7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-quobyte-779c1178-a16e-4654-bf26-0a32be656be7" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:51 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-779c1178-a16e-4654-bf26-0a32be656be7" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:51 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[160b0846-e06e-4c27-8020-419caaf4cf86]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:51 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:51 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7 Apr 15 10:15:51 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7" returned: 0 in 1.290s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7 Apr 15 10:15:52 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:52 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" returned: 0 in 2.288s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:52 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6faa8ebb-724d-4da5-82ec-41d6655b0666]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:52 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:52 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 Apr 15 10:15:52 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-779c1178-a16e-4654-bf26-0a32be656be7" returned: 0 in 0.443s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-779c1178-a16e-4654-bf26-0a32be656be7" released by "delete_volume" :: held 1.774s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Created reservations ['05042199-c9f2-473b-89c8-ea71411d08a3', 'a704af6a-7394-43cd-a356-0e263cebcc60', 'dcd073cc-c0c3-46df-84ea-7342b19e36a5', '437f56c3-eda9-44bb-9321-75461b9cdde5'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:53 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:53 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1" returned: 0 in 0.673s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1, size 1024.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:15:53 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Converted 1024.00 MB image at 447.22 MB/s Apr 15 10:15:53 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e is being set with open permissions: ugo+rw Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:53 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e Apr 15 10:15:53 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-b22bd686-4fa2-467d-897c-dc3aa70635af-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-b22bd686-4fa2-467d-897c-dc3aa70635af-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-quobyte-b22bd686-4fa2-467d-897c-dc3aa70635af" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-b22bd686-4fa2-467d-897c-dc3aa70635af" acquired by "delete_volume" :: waited 0.021s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[6155a77d-2f85-4a57-9933-5b916c9e4232]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:53 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.493s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:53 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Deleted volume successfully. Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b8127528-09bb-4475-b0b7-987c22f001c7 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-779c1178-a16e-4654-bf26-0a32be656be7-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:53 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af Apr 15 10:15:53 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" returned: 0 in 0.500s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" released by "_copy_volume_from_snapshot" :: held 4.526s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-2068bec8-6dba-493f-8366-4dcb8ab1e735-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" released by "_create_volume_from_snapshot" :: held 4.587s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.611s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.680s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1163102844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495ee27d-69d1-4f88-a142-8a492ce8a008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:48Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Creating volume 495ee27d-69d1-4f88-a142-8a492ce8a008 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:53 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:53 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008 1073741824 Apr 15 10:15:53 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a635dd-b268-46fb-882f-7171f8291d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e', 'volume_size': 1, 'snapshot_id': '2068bec8-6dba-493f-8366-4dcb8ab1e735'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd013144-4dc3-4178-b79d-d0f7e20233e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:53 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Volume volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e (bc69b5a7-602a-4895-ab32-c9a2bdfcba9e): created successfully Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd013144-4dc3-4178-b79d-d0f7e20233e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:53 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Flow 'volume_create_manager' (2677ac8b-e5e7-440b-98d8-314193ad90fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:53 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ad5fb88d-94a5-4c54-9257-afac09bb3198 tempest-VolumeDependencyTests-1201689548 None] Created volume successfully. Apr 15 10:15:54 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af" returned: 0 in 0.523s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:54 devstack sudo[90411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af Apr 15 10:15:54 devstack sudo[90411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:54 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008 1073741824" returned: 0 in 0.523s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:54 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008 Apr 15 10:15:54 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:54 devstack sudo[90411]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-b22bd686-4fa2-467d-897c-dc3aa70635af" returned: 0 in 0.473s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-b22bd686-4fa2-467d-897c-dc3aa70635af" released by "delete_volume" :: held 1.027s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Created reservations ['739c1f77-a494-4bb2-8f49-530691669fbd', '196e8a64-291a-4c5b-b70c-801abe968b99', '7d750b86-4098-4373-bcdc-8f103cf8438c', '5e46fd77-aef0-4a82-9077-8d4abe693fa8'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:54 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:54 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-2068bec8-6dba-493f-8366-4dcb8ab1e735-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-2068bec8-6dba-493f-8366-4dcb8ab1e735-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-5acaef84-8641-46d5-aec2-091826013be1" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-5acaef84-8641-46d5-aec2-091826013be1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-2068bec8-6dba-493f-8366-4dcb8ab1e735" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-2068bec8-6dba-493f-8366-4dcb8ab1e735" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Deleting offline snapshot 2068bec8-6dba-493f-8366-4dcb8ab1e735 of volume 5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:15:54 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] snapshot_file for this snap is: volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008" returned: 0 in 0.498s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d67104-dcfb-44c0-afc2-ba6965c1ff9f]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.400s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205bc2d3-9273-43cf-a26c-23afa87b01e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495ee27d-69d1-4f88-a142-8a492ce8a008', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aee36ba-680b-4953-be8d-3b52881734b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Creating offline snapshot 212b6d7e-a112-496d-b8a5-f2c896621c18 of volume f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:15:54 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume volume-495ee27d-69d1-4f88-a142-8a492ce8a008 (495ee27d-69d1-4f88-a142-8a492ce8a008): created successfully Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aee36ba-680b-4953-be8d-3b52881734b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (6c68706c-0cbd-43ed-b095-dfcd869c8f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f597f1-5176-4c2f-b5e2-c43d9b955bdf]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:54 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:55 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a3845348-bef0-4ed1-acf8-21f267f02f3d tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created volume successfully. Apr 15 10:15:55 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 Apr 15 10:15:55 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:55 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 Apr 15 10:15:55 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:55 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.503s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:55 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Deleted volume successfully. Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-72e4e524-3f26-4a83-9a8b-5397e434ecde tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-b22bd686-4fa2-467d-897c-dc3aa70635af-delete_volume" released by "delete_volume" :: held 1.689s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:55 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5acaef84-8641-46d5-aec2-091826013be1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ad94a0-23fb-446c-b8f6-13e31f606de7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:55 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8" returned: 0 in 0.519s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:55 devstack sudo[90434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 1G Apr 15 10:15:55 devstack sudo[90434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:55 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 Apr 15 10:15:55 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-02681eaf-966b-4a18-88b7-7275ddfd2b3f-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-02681eaf-966b-4a18-88b7-7275ddfd2b3f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-quobyte-02681eaf-966b-4a18-88b7-7275ddfd2b3f" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-02681eaf-966b-4a18-88b7-7275ddfd2b3f" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a86195d-d32b-409e-b0d5-bd3a42ac5012]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (1ce53452-eaad-4131-ad20-968870628cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e1cc05-691c-43dc-a947-8a3aec4ff962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:55 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e1cc05-691c-43dc-a947-8a3aec4ff962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1650525421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7c1424-a43d-4531-b791-c960621111b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7c0878-2890-4e96-bfe5-4c3e786b82d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b7c0878-2890-4e96-bfe5-4c3e786b82d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9694a4a7-ff5f-40be-840f-5453e393dcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9694a4a7-ff5f-40be-840f-5453e393dcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df7c1424-a43d-4531-b791-c960621111b9', 'volume_name': 'volume-df7c1424-a43d-4531-b791-c960621111b9', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da21c109-9093-4d7c-b304-f29bfeecb6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da21c109-9093-4d7c-b304-f29bfeecb6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c4ee8b-86e4-4952-8f0a-becfcd2279b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume df7c1424-a43d-4531-b791-c960621111b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df7c1424-a43d-4531-b791-c960621111b9', 'volume_size': 1} Apr 15 10:15:56 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f Apr 15 10:15:56 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (85ea52e2-8a81-49f8-82dd-6fa2fe46ec61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16320193-a0d5-4cf1-9754-7aa0781b3f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16320193-a0d5-4cf1-9754-7aa0781b3f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-710365196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4774b1-cf3a-4433-a079-3981076c3b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e4e2db-cc8b-4aa9-8f21-e3969cb47ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e4e2db-cc8b-4aa9-8f21-e3969cb47ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca7297c-0f8a-44de-8bf7-5df48869f75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca7297c-0f8a-44de-8bf7-5df48869f75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4774b1-cf3a-4433-a079-3981076c3b79', 'volume_name': 'volume-4b4774b1-cf3a-4433-a079-3981076c3b79', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3febaedf-8e3e-4645-be9f-4fe3f7173489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3febaedf-8e3e-4645-be9f-4fe3f7173489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f44acc-e425-44fb-ba36-eb597e0122dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume 4b4774b1-cf3a-4433-a079-3981076c3b79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4774b1-cf3a-4433-a079-3981076c3b79', 'volume_size': 1} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:56 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1" returned: 0 in 0.735s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:56 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 Apr 15 10:15:56 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:56 devstack sudo[90434]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 1G" returned: 0 in 0.782s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:56 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 Apr 15 10:15:56 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (3cec6863-0d3d-40b6-94de-b279e2864229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5b3fd7-c311-42d2-b5ff-cae1ecb6f135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5b3fd7-c311-42d2-b5ff-cae1ecb6f135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-446989789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ba3dc2-a103-4954-8773-81e58407812d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7984ab-82cc-43ad-a515-23dc35f5df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce7984ab-82cc-43ad-a515-23dc35f5df8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c56544-e502-43e9-8617-1f7212f729d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c56544-e502-43e9-8617-1f7212f729d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ba3dc2-a103-4954-8773-81e58407812d', 'volume_name': 'volume-e0ba3dc2-a103-4954-8773-81e58407812d', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad93c97-5d77-4845-8122-5767cddedece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad93c97-5d77-4845-8122-5767cddedece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e830888-cdcc-472b-a81c-f1debd32e73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume e0ba3dc2-a103-4954-8773-81e58407812d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ba3dc2-a103-4954-8773-81e58407812d', 'volume_size': 1} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:56 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (0c0a6faa-51e7-4d74-abae-ecc57b7a5f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f0fa38-7c2a-4724-ae66-0f25525024ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f" returned: 0 in 0.755s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f0fa38-7c2a-4724-ae66-0f25525024ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139659020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce3fe10-01c5-4a87-99fc-58b20d84332d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:57Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4c707b-8c55-435e-9555-6d6896289f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e4c707b-8c55-435e-9555-6d6896289f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d61b3f-3d71-44cc-84bc-2623e28d8242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40d61b3f-3d71-44cc-84bc-2623e28d8242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce3fe10-01c5-4a87-99fc-58b20d84332d', 'volume_name': 'volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa53da3-72cc-4d98-a229-5c6b7406af27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa53da3-72cc-4d98-a229-5c6b7406af27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc3fe35-0777-47e7-ba13-285d609fff8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume 0ce3fe10-01c5-4a87-99fc-58b20d84332d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d', 'volume_size': 1} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (3f370d75-71b9-41a4-a1a0-12e305c29790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f543a031-3a6a-4596-aad1-b8ad54d988c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f543a031-3a6a-4596-aad1-b8ad54d988c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1933597810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5972de5f-b60b-486e-812b-42ea55a024bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:57Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7bd6d6-7e61-4958-b79b-6707b2bae5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a7bd6d6-7e61-4958-b79b-6707b2bae5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4b287f-16b8-473b-8ef6-dc80230011f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc4b287f-16b8-473b-8ef6-dc80230011f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5972de5f-b60b-486e-812b-42ea55a024bd', 'volume_name': 'volume-5972de5f-b60b-486e-812b-42ea55a024bd', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90711df-af9e-4b0f-954d-a88df0320dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c90711df-af9e-4b0f-954d-a88df0320dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f02181b-c4a4-4fad-a6f0-8d64c233aea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:56 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume 5972de5f-b60b-486e-812b-42ea55a024bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5972de5f-b60b-486e-812b-42ea55a024bd', 'volume_size': 1} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18" returned: 0 in 0.681s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:56 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 is being set with open permissions: ugo+rw Apr 15 10:15:56 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:56 devstack sudo[90460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 Apr 15 10:15:56 devstack sudo[90460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:56 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735" returned: 0 in 0.778s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:57 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735 Apr 15 10:15:57 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:57 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-02681eaf-966b-4a18-88b7-7275ddfd2b3f" returned: 0 in 0.564s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-02681eaf-966b-4a18-88b7-7275ddfd2b3f" released by "delete_volume" :: held 1.348s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Created reservations ['5a1417c7-c104-4afb-9a74-bcdb6ab6d10a', 'f2f2b59b-cd7b-4a1b-b726-41d7fc0743f0', '89561e8a-1c18-4587-a258-d440baace68a', '4fffb4c4-9468-464b-a50f-d4615311a582'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:57 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:57 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:57 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1.2068bec8-6dba-493f-8366-4dcb8ab1e735" returned: 0 in 0.465s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:57 devstack sudo[90460]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18" returned: 0 in 0.498s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-2068bec8-6dba-493f-8366-4dcb8ab1e735" released by "_delete_snapshot" :: held 2.594s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-5acaef84-8641-46d5-aec2-091826013be1" released by "delete_snapshot" :: held 2.611s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:57 devstack sudo[90469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.info Apr 15 10:15:57 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Created reservations ['62f167ad-5104-4a75-9a00-95c413902486', '23bbaba3-c544-40a1-8f7d-37485600a1c5', '51ec14ce-d5e7-428d-b453-fdd1b8abd36a', '35b80009-f05a-4eff-9813-02a595e26dc6'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Delete snapshot completed successfully. Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-467e236f-3389-4400-bf2d-2eebb41a1fc4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-2068bec8-6dba-493f-8366-4dcb8ab1e735-delete_snapshot" released by "delete_snapshot" :: held 2.722s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:57 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.478s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:15:57 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Deleted volume successfully. Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d9a96bdb-973b-4964-9577-e956728bae81 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-02681eaf-966b-4a18-88b7-7275ddfd2b3f-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:57 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:57 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-ceabf892-1dcf-43c9-909a-1e88cd330216-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.info" returned: 0 in 0.469s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.info is being set with open permissions: ugo+rw Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-ceabf892-1dcf-43c9-909a-1e88cd330216-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:58 devstack sudo[90473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.info Apr 15 10:15:58 devstack sudo[90473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-quobyte-ceabf892-1dcf-43c9-909a-1e88cd330216" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-5acaef84-8641-46d5-aec2-091826013be1-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-5acaef84-8641-46d5-aec2-091826013be1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-ceabf892-1dcf-43c9-909a-1e88cd330216" acquired by "delete_volume" :: waited 0.021s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[805d3660-d184-46a5-9e7a-a0866492ebe7]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-5acaef84-8641-46d5-aec2-091826013be1" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-5acaef84-8641-46d5-aec2-091826013be1" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb59a2-27bc-4d55-8815-5c3db1fb143d]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack sudo[90475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216 Apr 15 10:15:58 devstack sudo[90475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack sudo[90476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 Apr 15 10:15:58 devstack sudo[90476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack sudo[90473]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.info" returned: 0 in 0.517s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.595s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.486s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1650525421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df7c1424-a43d-4531-b791-c960621111b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Creating volume df7c1424-a43d-4531-b791-c960621111b9 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:58 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9 1073741824 Apr 15 10:15:58 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-bde4fa86-b004-40b9-be82-53b66705e3a2 tempest-SnapshotDependencyTests-803932322 None] Create snapshot completed successfully Apr 15 10:15:58 devstack sudo[90475]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216" returned: 0 in 0.605s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack sudo[90476]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1" returned: 0 in 0.544s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:58 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:58 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216 Apr 15 10:15:58 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:58 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1 Apr 15 10:15:58 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:59 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9 1073741824" returned: 0 in 0.606s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:59 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9 Apr 15 10:15:59 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:59 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-ceabf892-1dcf-43c9-909a-1e88cd330216" returned: 0 in 0.520s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-ceabf892-1dcf-43c9-909a-1e88cd330216" released by "delete_volume" :: held 1.163s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Created reservations ['35d630c0-2c7c-4fef-899a-8f97e8771a50', 'f84e72eb-a422-46c1-b0a8-d3d12979421e', 'ea780b11-627c-4b8b-a1b4-7634399d1174', '13f8bdbc-3fe5-49bc-b1d7-a00122e3b015'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:59 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5acaef84-8641-46d5-aec2-091826013be1" returned: 0 in 0.586s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-5acaef84-8641-46d5-aec2-091826013be1" released by "delete_volume" :: held 1.185s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Flow 'volume_create_manager' (55c9bdad-2ab6-47c5-9bcf-e6c7fa09aa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1ec00b-7fe4-4002-85c8-917d40c80dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1ec00b-7fe4-4002-85c8-917d40c80dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e92d252-78d8-430e-ad86-e04629e5da3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e47ea36f25240bc8594d8a2f92958fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=212b6d7e-a112-496d-b8a5-f2c896621c18,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:59Z,use_quota=True,user_id='0a7c535e974e45c49f40e27b989fa1d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485191a3-8f4e-46b1-9aa9-d6b805bf04de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (485191a3-8f4e-46b1-9aa9-d6b805bf04de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daa1c11-386b-42c6-b235-ae7c8299fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4daa1c11-386b-42c6-b235-ae7c8299fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4e92d252-78d8-430e-ad86-e04629e5da3c', 'volume_name': 'volume-4e92d252-78d8-430e-ad86-e04629e5da3c', 'volume_size': 1, 'snapshot_id': '212b6d7e-a112-496d-b8a5-f2c896621c18'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f29e9a-d29c-4ee2-a564-084197c191bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f29e9a-d29c-4ee2-a564-084197c191bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf149e7-12e1-496a-878a-4b6fe83de4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:59 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Volume 4e92d252-78d8-430e-ad86-e04629e5da3c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4e92d252-78d8-430e-ad86-e04629e5da3c', 'volume_size': 1, 'snapshot_id': '212b6d7e-a112-496d-b8a5-f2c896621c18'} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Created reservations ['361b196f-f939-4b95-be59-52f1eafc5e41', '37c8e13f-6f81-4333-891a-f96c63c46f0c', '3c825677-ac35-49c1-9f3a-ee3a262a33bb', '2d76b455-2361-4aa4-83c6-e9c4066bf12c'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:15:59 devstack sudo[90499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:59 devstack sudo[90499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:59 devstack sudo[90501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:15:59 devstack sudo[90501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:59 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9" returned: 0 in 0.538s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.569s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-710365196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4774b1-cf3a-4433-a079-3981076c3b79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Creating volume 4b4774b1-cf3a-4433-a079-3981076c3b79 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:15:59 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c4ee8b-86e4-4952-8f0a-becfcd2279b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df7c1424-a43d-4531-b791-c960621111b9', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:59 devstack sudo[90504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79 1073741824 Apr 15 10:15:59 devstack sudo[90504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012687f6-ed79-46f5-b3dc-1e42c5b76f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:15:59 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume volume-df7c1424-a43d-4531-b791-c960621111b9 (df7c1424-a43d-4531-b791-c960621111b9): created successfully Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012687f6-ed79-46f5-b3dc-1e42c5b76f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:15:59 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (1ce53452-eaad-4131-ad20-968870628cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:15:59 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-95510934-54d8-4182-9e54-7fb3d362102f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created volume successfully. Apr 15 10:16:00 devstack sudo[90499]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.550s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Deleted volume successfully. Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4c71f104-994a-4918-bfca-0b7a224fe9e5 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-ceabf892-1dcf-43c9-909a-1e88cd330216-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:00 devstack sudo[90501]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.530s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:00 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Deleted volume successfully. Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b3f4ea56-3205-422f-b6da-9489a6946eeb tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-5acaef84-8641-46d5-aec2-091826013be1-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-97375a34-5868-45fb-bdb6-319d8a26e861-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-97375a34-5868-45fb-bdb6-319d8a26e861-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-quobyte-a850d26d-6ae8-45b5-9855-6fd7677e07eb" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-a850d26d-6ae8-45b5-9855-6fd7677e07eb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-quobyte-97375a34-5868-45fb-bdb6-319d8a26e861" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-97375a34-5868-45fb-bdb6-319d8a26e861" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Deleting offline snapshot 97375a34-5868-45fb-bdb6-319d8a26e861 of volume a850d26d-6ae8-45b5-9855-6fd7677e07eb {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] snapshot_file for this snap is: volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc32569a-b0c9-4bbc-95d8-86403156050a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 Apr 15 10:16:00 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack sudo[90504]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79 1073741824" returned: 0 in 0.687s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79 Apr 15 10:16:00 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Flow 'volume_create_manager' (9dd3742c-b552-41f8-aa0d-455f3fa3dd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281bde6c-d448-47a2-bc68-ac090d92605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (281bde6c-d448-47a2-bc68-ac090d92605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-826665019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f78662-998e-41f2-b676-0651a67ab0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b318dd5514f6bbc4713a5c32ae6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:01Z,use_quota=True,user_id='d02432d3b7774ff682edbe8c7331c674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec86924-9b52-444d-9f71-7460f003d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec86924-9b52-444d-9f71-7460f003d146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de05718c-202d-4f5b-83a5-c1961910091d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de05718c-202d-4f5b-83a5-c1961910091d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f78662-998e-41f2-b676-0651a67ab0ad', 'volume_name': 'volume-28f78662-998e-41f2-b676-0651a67ab0ad', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d664ac9-61bc-4d49-940f-7c0dad093916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d664ac9-61bc-4d49-940f-7c0dad093916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c081c6-4d79-4f4c-a79c-a47405031969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:00 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Volume 28f78662-998e-41f2-b676-0651a67ab0ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f78662-998e-41f2-b676-0651a67ab0ad', 'volume_size': 1} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:00 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861" returned: 0 in 0.585s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa76489-de4e-4cbd-9a76-9e356941163e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79" returned: 0 in 0.490s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.509s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-446989789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ba3dc2-a103-4954-8773-81e58407812d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:56Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Creating volume e0ba3dc2-a103-4954-8773-81e58407812d {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:00 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f44acc-e425-44fb-ba36-eb597e0122dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4774b1-cf3a-4433-a079-3981076c3b79', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:00 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d 1073741824 Apr 15 10:16:00 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb Apr 15 10:16:00 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:00 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d57950b-91a1-4902-a6c6-805177583339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:00 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume volume-4b4774b1-cf3a-4433-a079-3981076c3b79 (4b4774b1-cf3a-4433-a079-3981076c3b79): created successfully Apr 15 10:16:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d57950b-91a1-4902-a6c6-805177583339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:01 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (85ea52e2-8a81-49f8-82dd-6fa2fe46ec61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:01 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-025febc7-d7b4-4ea4-aa13-1c508a9d58c2 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created volume successfully. Apr 15 10:16:01 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb" returned: 0 in 0.579s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:01 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d 1073741824" returned: 0 in 0.544s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:01 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 Apr 15 10:16:01 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:01 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d Apr 15 10:16:01 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861" returned: 0 in 0.484s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:01 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:01 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861 Apr 15 10:16:01 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:01 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d" returned: 0 in 0.472s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.283s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-139659020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce3fe10-01c5-4a87-99fc-58b20d84332d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:57Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Creating volume 0ce3fe10-01c5-4a87-99fc-58b20d84332d {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:02 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e830888-cdcc-472b-a81c-f1debd32e73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ba3dc2-a103-4954-8773-81e58407812d', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd6e22b-85d1-45d0-aa5c-d2d0ee3be7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:02 devstack sudo[90574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d 1073741824 Apr 15 10:16:02 devstack sudo[90574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:02 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume volume-e0ba3dc2-a103-4954-8773-81e58407812d (e0ba3dc2-a103-4954-8773-81e58407812d): created successfully Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd6e22b-85d1-45d0-aa5c-d2d0ee3be7fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (3cec6863-0d3d-40b6-94de-b279e2864229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:02 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-2b713f2c-5f56-4bb4-98b1-9776a610986f tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created volume successfully. Apr 15 10:16:02 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb.97375a34-5868-45fb-bdb6-319d8a26e861" returned: 0 in 0.465s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-97375a34-5868-45fb-bdb6-319d8a26e861" released by "_delete_snapshot" :: held 2.193s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-a850d26d-6ae8-45b5-9855-6fd7677e07eb" released by "delete_snapshot" :: held 2.217s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Created reservations ['f9653c85-fbe1-458b-b8cf-126c982f9777', '120b8ac1-fa4c-4fba-9b03-0a971488e30c', 'a89277b3-7db2-40fc-9ed1-e5f43d45fa31', 'aa4b1f22-29ef-4cff-92bc-a5d4a1a4aeab'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:02 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Delete snapshot completed successfully. Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-cec4b484-0502-40b2-8b8f-688afcf32b5c tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-97375a34-5868-45fb-bdb6-319d8a26e861-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:02 devstack sudo[90574]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d 1073741824" returned: 0 in 0.588s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:02 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:02 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d Apr 15 10:16:02 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d" returned: 0 in 0.413s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.069s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:15:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1933597810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5972de5f-b60b-486e-812b-42ea55a024bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='143dd59e45c8470c81efea3cd96efd18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:15:57Z,use_quota=True,user_id='cc6bcf1c70c54881ab4153208e9da325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Creating volume 5972de5f-b60b-486e-812b-42ea55a024bd {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:03 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc3fe35-0777-47e7-ba13-285d609fff8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:03 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd 1073741824 Apr 15 10:16:03 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9748dcce-10ab-4c33-8e1c-078891ebdf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:03 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d (0ce3fe10-01c5-4a87-99fc-58b20d84332d): created successfully Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9748dcce-10ab-4c33-8e1c-078891ebdf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (0c0a6faa-51e7-4d74-abae-ecc57b7a5f4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:03 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-f619c856-6b7a-4b8c-b92a-7f50d79c9e20 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created volume successfully. Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-a850d26d-6ae8-45b5-9855-6fd7677e07eb-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-a850d26d-6ae8-45b5-9855-6fd7677e07eb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "cinder-quobyte-a850d26d-6ae8-45b5-9855-6fd7677e07eb" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-a850d26d-6ae8-45b5-9855-6fd7677e07eb" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03592b4-3dd9-4be9-b09f-9e1b1f7b2494]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb Apr 15 10:16:03 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd 1073741824" returned: 0 in 0.568s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:03 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd Apr 15 10:16:03 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:03 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb" returned: 0 in 0.510s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:03 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb Apr 15 10:16:04 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd" returned: 0 in 0.436s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.615s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "cinder-quobyte-212b6d7e-a112-496d-b8a5-f2c896621c18-4e92d252-78d8-430e-ad86-e04629e5da3c" by "_create_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f02181b-c4a4-4fad-a6f0-8d64c233aea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5972de5f-b60b-486e-812b-42ea55a024bd', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76491276-0bef-4a9c-97e3-e32e07967d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:04 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Volume volume-5972de5f-b60b-486e-812b-42ea55a024bd (5972de5f-b60b-486e-812b-42ea55a024bd): created successfully Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76491276-0bef-4a9c-97e3-e32e07967d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Flow 'volume_create_manager' (3f370d75-71b9-41a4-a1a0-12e305c29790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-212b6d7e-a112-496d-b8a5-f2c896621c18-4e92d252-78d8-430e-ad86-e04629e5da3c" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Creating volume 4e92d252-78d8-430e-ad86-e04629e5da3c from snapshot 212b6d7e-a112-496d-b8a5-f2c896621c18 {{(pid=82600) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "cinder-quobyte-4e92d252-78d8-430e-ad86-e04629e5da3c" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:04 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d5305362-04ca-42e2-8a1f-d18db5ddff82 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created volume successfully. Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-4e92d252-78d8-430e-ad86-e04629e5da3c" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] snapshot: 212b6d7e-a112-496d-b8a5-f2c896621c18, volume: 4e92d252-78d8-430e-ad86-e04629e5da3c, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[50139575-12e7-422e-a508-d9c7a72b8f83]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 Apr 15 10:16:04 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-5972de5f-b60b-486e-812b-42ea55a024bd-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-5972de5f-b60b-486e-812b-42ea55a024bd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-quobyte-5972de5f-b60b-486e-812b-42ea55a024bd" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:04 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-5972de5f-b60b-486e-812b-42ea55a024bd" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-a850d26d-6ae8-45b5-9855-6fd7677e07eb" returned: 0 in 0.551s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a1f1e5-aaa0-40b0-8385-8335da6e26d0]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-quobyte-a850d26d-6ae8-45b5-9855-6fd7677e07eb" released by "delete_volume" :: held 1.104s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Created reservations ['947879ec-8ccd-42a2-8821-264babc52174', 'a06172a6-17f3-4636-9fa1-babf3c86a086', '650bd67a-dc9d-4c29-a989-de4cdbd0da03', '0a321cd9-8b67-451c-a320-8b3f50db75d5'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:04 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd Apr 15 10:16:04 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[90604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:04 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:04 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18" returned: 0 in 0.580s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9984e3a-3e53-4216-a07a-0636df4e31a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[870b6aa8-6740-4c89-bb8d-1f61c85d1565]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:04 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:04 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 Apr 15 10:16:04 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:05 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd" returned: 0 in 0.538s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:05 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd Apr 15 10:16:05 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:05 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.477s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:05 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Deleted volume successfully. Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-01a4ebf8-c7c4-4a4f-8755-cbe6a8ff6f57 tempest-CreateVolumesFromSnapshotTest-810032428 None] Lock "cinder-a850d26d-6ae8-45b5-9855-6fd7677e07eb-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:05 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8" returned: 0 in 0.555s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:05 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c Apr 15 10:16:05 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:05 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-5972de5f-b60b-486e-812b-42ea55a024bd" returned: 0 in 0.485s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-5972de5f-b60b-486e-812b-42ea55a024bd" released by "delete_volume" :: held 1.057s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created reservations ['9d88cf92-0bf4-4a19-95aa-9dab9f4cd59f', 'cd4b99a0-4ba9-4db9-968e-b65b269143b3', '285a2ae2-13f8-4133-9a62-e5a8c07206ef', 'e0e109e7-ae3f-4178-be1e-cb9f46849950'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:05 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:05 devstack sudo[90623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:05 devstack sudo[90623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-0ce3fe10-01c5-4a87-99fc-58b20d84332d-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:06 devstack sudo[90623]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:06 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 1.232s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:06 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-0ce3fe10-01c5-4a87-99fc-58b20d84332d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:06 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Deleted volume successfully. Apr 15 10:16:06 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e38786c5-7c91-417e-8ec0-1f554f88345a tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-5972de5f-b60b-486e-812b-42ea55a024bd-delete_volume" released by "delete_volume" :: held 2.537s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-quobyte-0ce3fe10-01c5-4a87-99fc-58b20d84332d" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:07 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-0ce3fe10-01c5-4a87-99fc-58b20d84332d" acquired by "delete_volume" :: waited 0.012s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:07 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19323b7-eda2-475f-b4d2-19737cbbbd93]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:07 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d Apr 15 10:16:07 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:07 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c" returned: 0 in 2.541s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:07 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[00520496-c83f-40e8-8596-92e91679ca6e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:07 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:08 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d" returned: 0 in 0.930s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:08 devstack sudo[90647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 Apr 15 10:16:08 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:08 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d Apr 15 10:16:08 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:08 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-0ce3fe10-01c5-4a87-99fc-58b20d84332d" returned: 0 in 0.537s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-0ce3fe10-01c5-4a87-99fc-58b20d84332d" released by "delete_volume" :: held 1.508s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created reservations ['6d9bcbd3-c9c3-4e18-91ac-cdac477942fc', 'fad8a11d-e470-427b-8210-657c53850879', 'c8b7738a-838a-4d7d-9e8b-ff2b6d08fbf4', '3e5d51e2-f05f-4a6c-bf8a-d310d098ceff'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:08 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:08 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:08 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8" returned: 0 in 0.764s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8, size 1024.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:16:08 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Converted 1024.00 MB image at 402.74 MB/s Apr 15 10:16:08 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c is being set with open permissions: ugo+rw Apr 15 10:16:08 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:08 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c Apr 15 10:16:08 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:09 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.516s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Flow 'volume_create_manager' (91765c06-04a1-451b-87f0-ea577431ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8214f9d9-be14-43d8-93d6-3ebd3db7b9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:09 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Deleted volume successfully. Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8214f9d9-be14-43d8-93d6-3ebd3db7b9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57338d5819c4901984731763b0516bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:09Z,use_quota=True,user_id='770c658557b0492fb398aab70f233bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1ff15a-f36b-4faf-9070-e4e2576080a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1ff15a-f36b-4faf-9070-e4e2576080a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc196352-998f-479e-a1f0-faedb1dd827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc196352-998f-479e-a1f0-faedb1dd827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5', 'volume_name': 'volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8624665d-9446-4067-98a3-81f2530e08f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8624665d-9446-4067-98a3-81f2530e08f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7896072a-5c83-4de9-8e64-47b02cc66268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:09 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Volume 3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5', 'volume_size': 1} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-e0ba3dc2-a103-4954-8773-81e58407812d-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:09 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-ea4e0092-6931-4648-9ebd-da698bc1cdc8 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-0ce3fe10-01c5-4a87-99fc-58b20d84332d-delete_volume" released by "delete_volume" :: held 2.330s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c" returned: 0 in 0.575s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-4e92d252-78d8-430e-ad86-e04629e5da3c" released by "_copy_volume_from_snapshot" :: held 5.098s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-e0ba3dc2-a103-4954-8773-81e58407812d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-212b6d7e-a112-496d-b8a5-f2c896621c18-4e92d252-78d8-430e-ad86-e04629e5da3c" released by "_create_volume_from_snapshot" :: held 5.141s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.199s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.612s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-826665019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f78662-998e-41f2-b676-0651a67ab0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b318dd5514f6bbc4713a5c32ae6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:01Z,use_quota=True,user_id='d02432d3b7774ff682edbe8c7331c674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Creating volume 28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:09 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:09 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad 1073741824 Apr 15 10:16:09 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-quobyte-e0ba3dc2-a103-4954-8773-81e58407812d" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf149e7-12e1-496a-878a-4b6fe83de4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e92d252-78d8-430e-ad86-e04629e5da3c', 'volume_size': 1, 'snapshot_id': '212b6d7e-a112-496d-b8a5-f2c896621c18'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f0abc7-03fe-4ff8-bdc0-f32bca745368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-e0ba3dc2-a103-4954-8773-81e58407812d" acquired by "delete_volume" :: waited 0.026s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:09 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Volume volume-4e92d252-78d8-430e-ad86-e04629e5da3c (4e92d252-78d8-430e-ad86-e04629e5da3c): created successfully Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f0abc7-03fe-4ff8-bdc0-f32bca745368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Flow 'volume_create_manager' (55c9bdad-2ab6-47c5-9bcf-e6c7fa09aa95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c34d78a-cf86-4433-bad6-6580a85c5656]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:09 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-849c553b-80e0-41de-8d4c-d0757310e2cf tempest-SnapshotDependencyTests-803932322 None] Created volume successfully. Apr 15 10:16:09 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d Apr 15 10:16:09 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:09 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad 1073741824" returned: 0 in 0.567s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:09 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad Apr 15 10:16:09 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:09 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d" returned: 0 in 0.562s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:09 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:09 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d Apr 15 10:16:09 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "cinder-212b6d7e-a112-496d-b8a5-f2c896621c18-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-212b6d7e-a112-496d-b8a5-f2c896621c18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "cinder-quobyte-f9984e3a-3e53-4216-a07a-0636df4e31a8" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-f9984e3a-3e53-4216-a07a-0636df4e31a8" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "cinder-quobyte-212b6d7e-a112-496d-b8a5-f2c896621c18" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-212b6d7e-a112-496d-b8a5-f2c896621c18" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Deleting offline snapshot 212b6d7e-a112-496d-b8a5-f2c896621c18 of volume f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] snapshot_file for this snap is: volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[226aed2d-d6e3-4c05-91cb-b9442532f2dd]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_service.periodic_task [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82600) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:10 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:10 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:10 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 Apr 15 10:16:10 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:10 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad" returned: 0 in 0.545s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.209s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57338d5819c4901984731763b0516bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:09Z,use_quota=True,user_id='770c658557b0492fb398aab70f233bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Creating volume 3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:10 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6c081c6-4d79-4f4c-a79c-a47405031969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f78662-998e-41f2-b676-0651a67ab0ad', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d079e4ee-c9c0-49d9-bcc1-030903a3b801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:10 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 1073741824 Apr 15 10:16:10 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:10 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Volume volume-28f78662-998e-41f2-b676-0651a67ab0ad (28f78662-998e-41f2-b676-0651a67ab0ad): created successfully Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d079e4ee-c9c0-49d9-bcc1-030903a3b801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Flow 'volume_create_manager' (9dd3742c-b552-41f8-aa0d-455f3fa3dd3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:10 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-e0ba3dc2-a103-4954-8773-81e58407812d" returned: 0 in 0.568s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:10 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-42065c30-4558-4fae-aab3-d2bf14eb25c6 tempest-VolumeDependencyTests-1201689548 None] Created volume successfully. Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-e0ba3dc2-a103-4954-8773-81e58407812d" released by "delete_volume" :: held 1.171s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created reservations ['309f34c2-d8ff-45aa-9f0c-1751e61c3c95', 'bcffb4f7-6376-4feb-ad26-573c34a43bf8', '43319398-5b79-4f8b-a934-7e141494b625', 'f0fb091c-f8cc-4583-84d8-03475546e5e2'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:10 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:10 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:10 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.545s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-9cd3b4bc-83f8-43d1-ae94-0bb9494a1192 None None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:10 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18" returned: 0 in 0.586s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9984e3a-3e53-4216-a07a-0636df4e31a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48fe49d-52b7-48ea-b0c1-43cb4139bff3]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:10 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:10 devstack sudo[90689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 Apr 15 10:16:10 devstack sudo[90689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 1073741824" returned: 0 in 0.569s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 Apr 15 10:16:11 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.487s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:11 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Deleted volume successfully. Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-e5d10b62-fbc8-4a51-b08e-8250971daedd tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-e0ba3dc2-a103-4954-8773-81e58407812d-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:11 devstack sudo[90689]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8" returned: 0 in 0.583s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 Apr 15 10:16:11 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-4b4774b1-cf3a-4433-a079-3981076c3b79-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-4b4774b1-cf3a-4433-a079-3981076c3b79-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-quobyte-4b4774b1-cf3a-4433-a079-3981076c3b79" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-4b4774b1-cf3a-4433-a079-3981076c3b79" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[021c2fdc-9cd8-4edc-b35e-07daddc8f1f6]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5" returned: 0 in 0.499s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7896072a-5c83-4de9-8e64-47b02cc66268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad131ad-073a-46dd-a61a-38b98be037a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:11 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Volume volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 (3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5): created successfully Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dad131ad-073a-46dd-a61a-38b98be037a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Flow 'volume_create_manager' (91765c06-04a1-451b-87f0-ea577431ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:11 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-9564b171-ad83-44b6-a2f4-9842f5e7f09b tempest-CinderUnicodeTest-1670367417 None] Created volume successfully. Apr 15 10:16:11 devstack sudo[90703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79 Apr 15 10:16:11 devstack sudo[90703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Flow 'volume_create_manager' (ace06787-346b-44de-a069-6b3cba88ae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed1ff86-a790-4058-b503-5c679f517d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed1ff86-a790-4058-b503-5c679f517d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1023561440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4fe9f11-fd60-4a71-bd65-6bbe7419cce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b318dd5514f6bbc4713a5c32ae6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=28f78662-998e-41f2-b676-0651a67ab0ad,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:12Z,use_quota=True,user_id='d02432d3b7774ff682edbe8c7331c674',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1647f98-cf46-42b5-a169-4239584da02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1647f98-cf46-42b5-a169-4239584da02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b829489-3f91-4493-85c6-d5227bc8e003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b829489-3f91-4493-85c6-d5227bc8e003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f4fe9f11-fd60-4a71-bd65-6bbe7419cce6', 'volume_name': 'volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6', 'volume_size': 1, 'source_volid': '28f78662-998e-41f2-b676-0651a67ab0ad', 'source_volstatus': 'available'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c3c0ef-6f3b-4a6b-ba18-7d9d2d3a3f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c3c0ef-6f3b-4a6b-ba18-7d9d2d3a3f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8466b0ef-2fd7-4134-b79f-0340580d44d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:11 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Volume f4fe9f11-fd60-4a71-bd65-6bbe7419cce6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6', 'volume_size': 1, 'source_volid': '28f78662-998e-41f2-b676-0651a67ab0ad', 'source_volstatus': 'available'} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:11 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Cloning volume 28f78662-998e-41f2-b676-0651a67ab0ad to volume f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Creating offline snapshot a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f of volume 28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f17efdf-ef16-4216-b5ff-f8149e848c05]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18" returned: 0 in 0.553s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:11 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:11 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad Apr 15 10:16:11 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:11 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18 Apr 15 10:16:11 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack sudo[90703]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79" returned: 0 in 0.585s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79 Apr 15 10:16:12 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad" returned: 0 in 0.601s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f 1G Apr 15 10:16:12 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8.212b6d7e-a112-496d-b8a5-f2c896621c18" returned: 0 in 0.580s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-212b6d7e-a112-496d-b8a5-f2c896621c18" released by "_delete_snapshot" :: held 2.369s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-f9984e3a-3e53-4216-a07a-0636df4e31a8" released by "delete_snapshot" :: held 2.393s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:12 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4b4774b1-cf3a-4433-a079-3981076c3b79" returned: 0 in 0.476s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-4b4774b1-cf3a-4433-a079-3981076c3b79" released by "delete_volume" :: held 1.088s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Created reservations ['8b4ef17b-1a65-4d48-9c54-4e88922193d4', 'dd642685-fda3-489f-9bfa-a42b68f187ad', '267fa678-4b12-4a54-bc7e-15c7f1c078b6', '9e9cd1ff-abda-4fb8-95e2-8a83817e6808'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:12 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Delete snapshot completed successfully. Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-a5a62cd2-faa3-4427-bea0-a7361885a798 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-212b6d7e-a112-496d-b8a5-f2c896621c18-delete_snapshot" released by "delete_snapshot" :: held 2.540s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created reservations ['a17762c4-2683-44e8-8f18-017deba768dd', '1f51348d-e3b0-4978-8529-ae6cdc5b3b92', 'ec901ec4-2af3-41f8-a9f8-30f0e9363a4b', '46aba017-b7dc-43c4-8c26-3f00f3c361e3'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:12 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:12 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.flows.manager.create_volume [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82600) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Flow 'volume_create_manager' (79f95a94-3a2d-46fa-884d-45c5566520ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f544b90-d5db-4983-afb3-a37e005143fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f544b90-d5db-4983-afb3-a37e005143fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1216618451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7892acc0-1b7a-44b1-956b-6cd9431adfd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57338d5819c4901984731763b0516bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:13Z,use_quota=True,user_id='770c658557b0492fb398aab70f233bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570d0762-83ec-4bab-9659-80ae46f21f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570d0762-83ec-4bab-9659-80ae46f21f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f804257-6a30-4477-a3c3-89ec6c3ade42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f804257-6a30-4477-a3c3-89ec6c3ade42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7892acc0-1b7a-44b1-956b-6cd9431adfd0', 'volume_name': 'volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f619a5c5-705e-4a45-9444-70b7a9a69695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f619a5c5-705e-4a45-9444-70b7a9a69695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0c7309-a4b5-42c8-b471-0258ba4d7e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:12 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Volume 7892acc0-1b7a-44b1-956b-6cd9431adfd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0', 'volume_size': 1} Apr 15 10:16:12 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:13 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f 1G" returned: 0 in 0.644s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28f78662-998e-41f2-b676-0651a67ab0ad -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:13 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28f78662-998e-41f2-b676-0651a67ab0ad -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f Apr 15 10:16:13 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:13 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.524s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:13 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Deleted volume successfully. Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-b5e202e6-292b-4b54-bafc-c8978aae0b77 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-4b4774b1-cf3a-4433-a079-3981076c3b79-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "cinder-f9984e3a-3e53-4216-a07a-0636df4e31a8-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-f9984e3a-3e53-4216-a07a-0636df4e31a8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "cinder-quobyte-f9984e3a-3e53-4216-a07a-0636df4e31a8" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-f9984e3a-3e53-4216-a07a-0636df4e31a8" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0be096-509c-42ed-ae36-257dcb7a19bb]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:13 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 Apr 15 10:16:13 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-df7c1424-a43d-4531-b791-c960621111b9-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-df7c1424-a43d-4531-b791-c960621111b9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-quobyte-df7c1424-a43d-4531-b791-c960621111b9" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:13 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28f78662-998e-41f2-b676-0651a67ab0ad -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f" returned: 0 in 0.607s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f is being set with open permissions: ugo+rw Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-df7c1424-a43d-4531-b791-c960621111b9" acquired by "delete_volume" :: waited 0.022s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:13 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f Apr 15 10:16:13 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9c8aac-f1fe-4ce7-acfd-f804e3994afe]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:13 devstack sudo[90740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9 Apr 15 10:16:13 devstack sudo[90740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:13 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8" returned: 0 in 0.584s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:13 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[90745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8 Apr 15 10:16:14 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:14 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f" returned: 0 in 0.469s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.info Apr 15 10:16:14 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:14 devstack sudo[90740]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9" returned: 0 in 0.542s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9 Apr 15 10:16:14 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:14 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f9984e3a-3e53-4216-a07a-0636df4e31a8" returned: 0 in 0.513s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-f9984e3a-3e53-4216-a07a-0636df4e31a8" released by "delete_volume" :: held 1.136s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Created reservations ['2707face-0056-4ba5-8589-f1999d17f814', 'd810d959-0935-43bc-bb0a-adb12d206fbc', '59e853b7-9dae-4a06-9db9-98b157543979', '32d1a136-aff1-4a3c-8478-04e1af20516d'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:14 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:14 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-df7c1424-a43d-4531-b791-c960621111b9" returned: 0 in 0.475s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:14 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-df7c1424-a43d-4531-b791-c960621111b9" released by "delete_volume" :: held 1.046s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.info" returned: 0 in 0.538s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:14 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.info is being set with open permissions: ugo+rw Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.info Apr 15 10:16:14 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created reservations ['a7803fc0-2e21-4440-8ad9-59ecf65a2d4e', '77c5b948-a566-4aec-bc2b-fd0a475815ce', 'd05aae45-6061-4370-a61e-3c61d972bdc8', '417c090a-5764-41f0-a2eb-048246a123f4'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:14 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:14 devstack sudo[90762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:14 devstack sudo[90762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:15 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.474s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:15 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Deleted volume successfully. Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-0b648498-adab-43ae-8bf8-a12f0f83742c tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-f9984e3a-3e53-4216-a07a-0636df4e31a8-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:15 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.info" returned: 0 in 0.450s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" by "_copy_volume_from_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] snapshot: a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f, volume: f4fe9f11-fd60-4a71-bd65-6bbe7419cce6, {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[2754a65f-3d09-4d84-87f7-12a2303c106c]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:15 devstack sudo[90762]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.434s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:15 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Deleted volume successfully. Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8ff43ddd-8a4c-48c1-a08d-1a871ce51f62 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-df7c1424-a43d-4531-b791-c960621111b9-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:15 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f Apr 15 10:16:15 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "cinder-4e92d252-78d8-430e-ad86-e04629e5da3c-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-4e92d252-78d8-430e-ad86-e04629e5da3c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "cinder-quobyte-4e92d252-78d8-430e-ad86-e04629e5da3c" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-4e92d252-78d8-430e-ad86-e04629e5da3c" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ed3b41-4f0b-41a9-ab73-2aade7bfd1af]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:15 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c Apr 15 10:16:15 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:15 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f" returned: 0 in 0.513s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28f78662-998e-41f2-b676-0651a67ab0ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Creating direct copy from snapshot {{(pid=82600) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3acfff-1e5f-4133-a89b-81e477fef07a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-495ee27d-69d1-4f88-a142-8a492ce8a008-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-495ee27d-69d1-4f88-a142-8a492ce8a008-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "cinder-quobyte-495ee27d-69d1-4f88-a142-8a492ce8a008" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-495ee27d-69d1-4f88-a142-8a492ce8a008" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[24293eb5-925f-4a28-b33c-9a49b47d64e1]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:15 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:15 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad Apr 15 10:16:15 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:16 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008 Apr 15 10:16:16 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:16 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c" returned: 0 in 0.539s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:16 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c Apr 15 10:16:16 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:16 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad" returned: 0 in 0.580s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG cinder.utils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Path /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 not found in is_blk_device check {{(pid=82600) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:16 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 Apr 15 10:16:16 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:16 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008" returned: 0 in 0.524s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:16 devstack sudo[90791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008 Apr 15 10:16:16 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:16 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-4e92d252-78d8-430e-ad86-e04629e5da3c" returned: 0 in 0.483s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-quobyte-4e92d252-78d8-430e-ad86-e04629e5da3c" released by "delete_volume" :: held 1.046s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Created reservations ['f322a316-3e12-48e0-9bac-04e42203af1e', '3f6ed470-0800-400f-9e65-d10e7b722be2', 'cfd86f9e-4d78-43bd-89b4-3cb8283db557', '404d1426-bc46-4f6e-8140-aae0dbafdddc'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:16 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:16 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:16 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:16 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-495ee27d-69d1-4f88-a142-8a492ce8a008" returned: 0 in 0.522s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-quobyte-495ee27d-69d1-4f88-a142-8a492ce8a008" released by "delete_volume" :: held 1.085s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Created reservations ['6c4474a1-3f9f-468b-8e72-50710e7008a9', 'b0ff3839-c262-46e1-852b-67960366fb21', 'af82be5c-2792-4204-a29f-d48f3edd3df9', '133e9ae5-fcd5-4f5d-b6a0-f5d223e37714'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:17 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:17 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.665s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:17 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:17 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Deleted volume successfully. Apr 15 10:16:17 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-16c6246f-a11a-402c-b99f-4845361479b4 tempest-SnapshotDependencyTests-803932322 None] Lock "cinder-4e92d252-78d8-430e-ad86-e04629e5da3c-delete_volume" released by "delete_volume" :: held 1.874s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:18 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.942s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:18 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:18 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Deleted volume successfully. Apr 15 10:16:18 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-44aa288d-864a-4e73-a955-b906b100efd6 tempest-CreateVolumesFromSourceVolumeTest-63444987 None] Lock "cinder-495ee27d-69d1-4f88-a142-8a492ce8a008-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:18 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" returned: 0 in 2.531s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:18 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[b916a97c-e574-4615-b5a1-aeab90b08257]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:18 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:19 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad Apr 15 10:16:19 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:19 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad" returned: 0 in 0.722s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:19 devstack cinder-volume[82600]: DEBUG cinder.image.image_utils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Image conversion details: src /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad, size 1024.00 MB, duration 2.53 sec, destination /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 {{(pid=82600) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 15 10:16:19 devstack cinder-volume[82600]: INFO cinder.image.image_utils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Converted 1024.00 MB image at 404.40 MB/s Apr 15 10:16:19 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 is being set with open permissions: ugo+rw Apr 15 10:16:19 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:19 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 Apr 15 10:16:19 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:20 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" returned: 0 in 0.486s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" released by "_copy_volume_from_snapshot" :: held 4.880s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Deleting offline snapshot a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f of volume 28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] snapshot_file for this snap is: volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[7556f9a7-98d7-41dc-b160-60597be84db1]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:20 devstack sudo[90821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f Apr 15 10:16:20 devstack sudo[90821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:20 devstack sudo[90821]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f" returned: 0 in 0.583s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28f78662-998e-41f2-b676-0651a67ab0ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa470e5e-238d-4b8b-975b-560346cd773e]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:20 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:20 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad Apr 15 10:16:20 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:21 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad" returned: 0 in 0.584s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:21 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f Apr 15 10:16:21 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:21 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f" returned: 0 in 0.578s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:21 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:22 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f Apr 15 10:16:22 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:22 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad.a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f" returned: 0 in 0.512s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-a3e5593b-9f89-4e39-bc68-bcf7cc1cec0f" released by "_delete_snapshot" :: held 2.309s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:UPDATE=249,cinder:SELECT=195,cinder:INSERT=47,cinder:DELETE=20 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.677s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.661s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-15T08:16:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1216618451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7892acc0-1b7a-44b1-956b-6cd9431adfd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d57338d5819c4901984731763b0516bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-15T08:16:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-15T08:16:13Z,use_quota=True,user_id='770c658557b0492fb398aab70f233bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(44bdfc56-0000-459b-8418-e5ecba330c3b),volume_type_id=44bdfc56-0000-459b-8418-e5ecba330c3b)}" {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Creating volume 7892acc0-1b7a-44b1-956b-6cd9431adfd0 {{(pid=82600) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Selected osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c as target Quobyte volume. {{(pid=82600) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 15 10:16:22 devstack cinder-volume[82600]: INFO cinder.volume.drivers.remotefs [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] casted to osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 1073741824 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:22 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 1073741824 Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8466b0ef-2fd7-4134-b79f-0340580d44d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6', 'volume_size': 1, 'source_volid': '28f78662-998e-41f2-b676-0651a67ab0ad', 'source_volstatus': 'available'}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:22 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13087084-3d81-45a4-a7ae-7a118416983b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:22 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Volume volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 (f4fe9f11-fd60-4a71-bd65-6bbe7419cce6): created successfully Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13087084-3d81-45a4-a7ae-7a118416983b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Flow 'volume_create_manager' (ace06787-346b-44de-a069-6b3cba88ae94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:22 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4ceecadb-5e85-4bfc-90f5-1a5670d24cde tempest-VolumeDependencyTests-1201689548 None] Created volume successfully. Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-28f78662-998e-41f2-b676-0651a67ab0ad-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-28f78662-998e-41f2-b676-0651a67ab0ad-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-28f78662-998e-41f2-b676-0651a67ab0ad" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-28f78662-998e-41f2-b676-0651a67ab0ad" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[62551c23-7b32-497a-83dc-6fbfc35906ec]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:22 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:22 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad Apr 15 10:16:22 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:23 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 1073741824" returned: 0 in 0.630s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:SELECT=166,cinder:UPDATE=258,cinder:DELETE=27,cinder:INSERT=72 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:23 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 Apr 15 10:16:23 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:23 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad" returned: 0 in 0.626s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:23 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad Apr 15 10:16:23 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:23 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0" returned: 0 in 0.498s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'} {{(pid=82600) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec0c7309-a4b5-42c8-b471-0258ba4d7e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0', 'volume_size': 1}' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a45af6-184e-4330-97d8-3bcb1040becf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 15 10:16:23 devstack cinder-volume[82600]: INFO cinder.volume.flows.manager.create_volume [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Volume volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 (7892acc0-1b7a-44b1-956b-6cd9431adfd0): created successfully Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2a45af6-184e-4330-97d8-3bcb1040becf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82600) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Flow 'volume_create_manager' (79f95a94-3a2d-46fa-884d-45c5566520ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82600) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 15 10:16:23 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-10bc2764-8141-4fdd-9675-d1111f23430c tempest-CinderUnicodeTest-1670367417 None] Created volume successfully. Apr 15 10:16:23 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:23 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-28f78662-998e-41f2-b676-0651a67ab0ad" returned: 0 in 0.508s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-28f78662-998e-41f2-b676-0651a67ab0ad" released by "delete_volume" :: held 1.168s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Created reservations ['b818bcb4-3243-4f73-a769-a61bf37c2bf1', '94b6c49f-8f45-4567-889c-61a7c54e25d6', 'b150fb03-cfe4-42ec-9ec0-477b46724c6f', 'aa1925ad-54d3-4fe4-8841-61b91ff03fe9'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:24 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:24 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:24 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.492s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:24 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Deleted volume successfully. Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-6b274e83-378e-4933-a1ee-7427b2d96ce4 tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-28f78662-998e-41f2-b676-0651a67ab0ad-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:24 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" acquired by "delete_volume" :: waited 0.020s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3433e2a-a433-40c0-91c7-1b3b0e15e37a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Creating offline snapshot e2de8cff-9489-489c-b40b-0e7ba5f098a6 of volume 7892acc0-1b7a-44b1-956b-6cd9431adfd0 {{(pid=82600) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f017db-2cc5-476d-851d-a650a59e8544]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:25 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 Apr 15 10:16:25 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:25 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 Apr 15 10:16:25 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:25 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0" returned: 0 in 0.536s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 1G {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:25 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 1G Apr 15 10:16:25 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:25 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" returned: 0 in 0.584s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:25 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:25 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6 Apr 15 10:16:25 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:26 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" returned: 0 in 0.521s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6" released by "delete_volume" :: held 1.154s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Created reservations ['52c3dc07-2836-4fe6-b6df-4ec8a34993af', '68600f7d-cf2f-4967-b1db-d8e26a87b9f6', '63b5150f-bce5-403e-b11c-667bcf30b655', 'e2ca8a90-3312-4e3a-8d37-5730b7d69391'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:26 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 1G" returned: 0 in 0.669s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:26 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:26 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:26 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 Apr 15 10:16:26 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:26 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.460s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:26 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Deleted volume successfully. Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-418c711f-273c-4c09-a166-4df22c47492c tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-f4fe9f11-fd60-4a71-bd65-6bbe7419cce6-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:26 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 -F qcow2 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6" returned: 0 in 0.474s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:26 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 is being set with open permissions: ugo+rw Apr 15 10:16:26 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:26 devstack sudo[90889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 Apr 15 10:16:26 devstack sudo[90889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:27 devstack sudo[90889]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6" returned: 0 in 0.421s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:27 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.info Apr 15 10:16:27 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "cinder-quobyte-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" acquired by "delete_volume" :: waited 0.014s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec42d688-b0a2-4167-a096-16f51bdf591a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:27 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e Apr 15 10:16:27 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:27 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.info" returned: 0 in 0.434s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:27 devstack cinder-volume[82600]: WARNING cinder.volume.drivers.remotefs [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.info is being set with open permissions: ugo+rw Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.info {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:27 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.info Apr 15 10:16:27 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:27 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" returned: 0 in 0.529s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:27 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:27 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e Apr 15 10:16:27 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:28 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.info" returned: 0 in 0.431s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.046s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:28 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-554709cc-3890-4c6d-a00f-a6ac66d6eca3 tempest-CinderUnicodeTest-1670367417 None] Create snapshot completed successfully Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "cinder-e2de8cff-9489-489c-b40b-0e7ba5f098a6-delete_snapshot" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-e2de8cff-9489-489c-b40b-0e7ba5f098a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "cinder-quobyte-7892acc0-1b7a-44b1-956b-6cd9431adfd0" by "delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-quobyte-7892acc0-1b7a-44b1-956b-6cd9431adfd0" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "cinder-quobyte-e2de8cff-9489-489c-b40b-0e7ba5f098a6" by "_delete_snapshot" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-quobyte-e2de8cff-9489-489c-b40b-0e7ba5f098a6" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Deleting offline snapshot e2de8cff-9489-489c-b40b-0e7ba5f098a6 of volume 7892acc0-1b7a-44b1-956b-6cd9431adfd0 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] snapshot_file for this snap is: volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 {{(pid=82600) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4051556-f825-4dc1-95b6-3c96f3c2c68c]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:28 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" returned: 0 in 0.480s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-quobyte-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e" released by "delete_volume" :: held 1.034s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:28 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 Apr 15 10:16:28 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Created reservations ['4cb0f9b6-e9b7-49ff-ace1-f404d5d3c13c', '8e361ab0-e623-4c66-9626-a1afc97af87c', '1fbef36b-ff08-41c6-839b-73e0a0a6d954', '35476e38-bb09-45c9-a2ac-b0e0e196d320'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:28 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:28 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:28 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6" returned: 0 in 0.581s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.remotefs [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82600) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 15 10:16:28 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.422s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5771e49-6c48-4478-85ba-df2a3abe4516]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:28 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Deleted volume successfully. Apr 15 10:16:28 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-8a875c04-7d64-4264-98ac-9d9fbb2cf6ed tempest-VolumeDependencyTests-1201689548 None] Lock "cinder-bc69b5a7-602a-4895-ab32-c9a2bdfcba9e-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:28 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 Apr 15 10:16:28 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:29 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0" returned: 0 in 0.559s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:29 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 Apr 15 10:16:29 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:29 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6" returned: 0 in 0.543s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:29 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:30 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6 Apr 15 10:16:30 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:30 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:30 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0.e2de8cff-9489-489c-b40b-0e7ba5f098a6" returned: 0 in 0.546s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-quobyte-e2de8cff-9489-489c-b40b-0e7ba5f098a6" released by "_delete_snapshot" :: held 2.298s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-quobyte-7892acc0-1b7a-44b1-956b-6cd9431adfd0" released by "delete_snapshot" :: held 2.312s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:30 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Created reservations ['142e00bf-089d-4b88-85ef-987f0e79a7c6', '4fd52d2a-05cd-49ee-877f-6e1c52af8658', '141a5b9a-d1a0-4ae0-a75e-0120fdd7cfe5', 'efe4e00b-f3bb-4d2b-ab8b-67192daeb3cc'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:30 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Delete snapshot completed successfully. Apr 15 10:16:30 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-d4a09617-d272-489b-a56d-547cd11fef3d tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-e2de8cff-9489-489c-b40b-0e7ba5f098a6-delete_snapshot" released by "delete_snapshot" :: held 2.428s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "cinder-7892acc0-1b7a-44b1-956b-6cd9431adfd0-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-7892acc0-1b7a-44b1-956b-6cd9431adfd0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "cinder-quobyte-7892acc0-1b7a-44b1-956b-6cd9431adfd0" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:31 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-quobyte-7892acc0-1b7a-44b1-956b-6cd9431adfd0" acquired by "delete_volume" :: waited 0.011s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:31 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb87cfe-2ca8-4aaf-a3d0-f2a8f0d61f7a]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:31 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:31 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 Apr 15 10:16:31 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:32 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0" returned: 0 in 0.568s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:32 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0 Apr 15 10:16:32 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:32 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-7892acc0-1b7a-44b1-956b-6cd9431adfd0" returned: 0 in 0.464s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-quobyte-7892acc0-1b7a-44b1-956b-6cd9431adfd0" released by "delete_volume" :: held 1.068s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Created reservations ['22ca71e1-6e1e-4a6f-9a6f-d149a6d1da3f', 'df9f7fbc-8d1a-4b09-9b10-d4ab5280a420', '44384d61-5894-4f65-b420-94ab19da4977', 'ecb1c4c3-a90e-48aa-82c1-8cdacb2e2d19'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:32 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:32 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:32 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:33 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.423s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:33 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:33 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Deleted volume successfully. Apr 15 10:16:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-4e0c3cdd-4c8a-47c4-be79-d736e7ad3107 tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-7892acc0-1b7a-44b1-956b-6cd9431adfd0-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "cinder-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5-delete_volume" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "cinder-quobyte-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5" by "delete_volume" {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 15 10:16:33 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-quobyte-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5" acquired by "delete_volume" :: waited 0.010s {{(pid=82600) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 15 10:16:33 devstack cinder-volume[82600]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c7e1f0-50ed-4b8b-a98e-a56ae2445ff8]: (4, 'qcow2') {{(pid=83676) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 15 10:16:33 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:33 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 Apr 15 10:16:33 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:34 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5" returned: 0 in 0.477s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:34 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5 Apr 15 10:16:34 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:34 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de/volume-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5" returned: 0 in 0.409s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-quobyte-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5" released by "delete_volume" :: held 0.913s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG cinder.quota [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Created reservations ['98aa9af0-f255-43ec-a268-37b34f325450', '63949735-90d1-49d8-abd6-88ca2bc8d389', '0fa5f5db-db57-4947-9847-b76816163bdd', '0d0e3de7-f962-445c-9621-6be30fe39299'] {{(pid=82600) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c': None} {{(pid=82600) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG cinder.volume.drivers.quobyte [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-46dbaa63-c8f6-43c1-b374-4c315940868c'] {{(pid=82600) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.lockutils [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82600) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 15 10:16:34 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 15 10:16:34 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de Apr 15 10:16:34 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 15 10:16:35 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 15 10:16:35 devstack cinder-volume[82600]: DEBUG oslo_concurrency.processutils [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5579b791dddb28c6603452dca30b14de" returned: 0 in 0.486s {{(pid=82600) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 15 10:16:35 devstack cinder-volume[82600]: DEBUG cinder.manager [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Notifying Schedulers of capabilities ... {{(pid=82600) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 15 10:16:35 devstack cinder-volume[82600]: INFO cinder.volume.manager [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Deleted volume successfully. Apr 15 10:16:35 devstack cinder-volume[82600]: DEBUG cinder.coordination [None req-05ccf008-dc6d-47ff-9c4c-6f6fbd69a677 tempest-CinderUnicodeTest-1670367417 None] Lock "cinder-3a6efaf7-0230-4f2c-94fa-9c5204eb5ed5-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82600) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 15 10:16:44 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:UPDATE=58,cinder:SELECT=36,cinder:INSERT=9,cinder:DELETE=2 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 15 10:16:45 devstack cinder-volume[82600]: DEBUG dbcounter [-] [82600] Writing DB stats cinder:DELETE=5,cinder:SELECT=33,cinder:INSERT=17,cinder:UPDATE=40 {{(pid=82600) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}